Jul 22 20:29:21 devstack cinder-volume[76636]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 20:29:21 devstack cinder-volume[76636]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 20:29:21 devstack cinder-volume[76636]: we strongly recommend against using it for new projects. Jul 22 20:29:21 devstack cinder-volume[76636]: If you are already using Eventlet, we recommend migrating to a different Jul 22 20:29:21 devstack cinder-volume[76636]: framework. For more detail see Jul 22 20:29:21 devstack cinder-volume[76636]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 20:29:21 devstack cinder-volume[76636]: import eventlet # noqa Jul 22 20:29:24 devstack cinder-volume[76636]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 20:29:24 devstack cinder-volume[76636]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 20:29:24 devstack cinder-volume[76636]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 20:29:24 devstack cinder-volume[76636]: INFO dbcounter [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Registered counter for database cinder Jul 22 20:29:25 devstack cinder-volume[76636]: DEBUG oslo_db.sqlalchemy.engines [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:29:25 devstack cinder-volume[76636]: DEBUG dbcounter [-] [76636] Writer thread running {{(pid=76636) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 20:29:25 devstack cinder-volume[76636]: INFO cinder.rpc [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 20:29:25 devstack cinder-volume[76636]: INFO cinder.rpc [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 20:29:25 devstack cinder-volume[76636]: DEBUG oslo_db.sqlalchemy.engines [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:29:25 devstack cinder-volume[76636]: INFO cinder.volume.manager [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Determined volume DB was empty at startup. Jul 22 20:29:25 devstack cinder-volume[76636]: DEBUG cinder.volume.manager [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76636) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 20:29:25 devstack cinder-volume[76636]: INFO cinder.volume.manager [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 20:29:25 devstack cinder-volume[76636]: WARNING stevedore.named [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 20:29:25 devstack cinder-volume[76636]: WARNING castellan.key_manager [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 20:29:25 devstack cinder-volume[76636]: WARNING cinder.keymgr.conf_key_mgr [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 20:29:25 devstack cinder-volume[76636]: DEBUG cinder.volume.drivers.lvm [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76636) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 22 20:29:25 devstack cinder-volume[76636]: DEBUG oslo_concurrency.processutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_concurrency.processutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.502s {{(pid=76636) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_db.sqlalchemy.engines [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:29:26 devstack cinder-volume[76636]: INFO cinder.rpc [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 22 20:29:26 devstack cinder-volume[76636]: INFO cinder.rpc [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 22 20:29:26 devstack cinder-volume[76636]: WARNING stevedore.named [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 20:29:26 devstack cinder-volume[76636]: WARNING castellan.key_manager [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 20:29:26 devstack cinder-volume[76636]: INFO cinder.volume.manager [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_db.sqlalchemy.engines [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76636) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:29:26 devstack cinder-volume[76636]: INFO oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Starting 1 workers Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Started child 76780 {{(pid=76636) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Full set of CONF: {{(pid=76636) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] ******************************************************************************** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Configuration options gathered from: {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] ================================================================================ {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] allow_availability_zone_fallback = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] allow_compression_on_image_upload = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] allowed_direct_url_schemes = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] api_rate_limit = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] auth_strategy = keystone {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] az_cache_duration = 3600 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_availability_zone = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_host = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_stats_polling_interval = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backup_api_class = cinder.backup.api.API {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backup_name_template = backup-%s {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backup_use_same_host = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backup_use_temp_snapshot = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76780]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] chap_password = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] chap_username = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_internal_tenant_project_id = 7fcb14ecfba64f29bdee5fcd12f75da2 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_internal_tenant_user_id = b6454331e1db44f4a9576ab5b6eeb042 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cloned_volume_same_az = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cluster = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] compression_format = gzip {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] compute_api_class = cinder.compute.nova.API {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] config_dir = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] config_source = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] control_exchange = openstack {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] debug = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] default_availability_zone = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] default_group_type = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] default_volume_type = lvmdriver-1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] disk_geometry = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] driver_client_cert = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] driver_client_cert_key = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] driver_data_namespace = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] driver_ssl_cert_path = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] driver_ssl_cert_verify = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] driver_use_ssl = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] enable_force_upload = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] enable_new_services = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] enable_unsupported_driver = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] enforce_multipath_for_image_xfer = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] filter_function = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_api_insecure = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_api_ssl_compression = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_ca_certificates_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_catalog_info = image:glance:publicURL {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_num_retries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance_request_timeout = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] goodness_function = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] graceful_shutdown_timeout = 5 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] group_api_class = cinder.group.api.API {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] host = devstack {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_compress_on_upload = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_conversion_address_space_limit = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_conversion_cpu_limit = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_conversion_disable = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_upload_use_cinder_backend = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_upload_use_internal_tenant = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_volume_cache_enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_volume_cache_max_count = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] image_volume_cache_max_size_gb = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] init_host_max_objects_retrieval = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] instance_format = [instance: %(uuid)s] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] iscsi_target_flags = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] iscsi_write_cache = on {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] iser_helper = tgtadm {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] iser_ip_address = 192.168.122.246 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] iser_port = 3260 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_color = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_config_append = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_dir = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_options = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_rotate_interval = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_rotate_interval_type = days {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] log_rotation_type = none {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] max_age = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] max_logfile_count = 30 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] max_logfile_size_mb = 200 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] max_over_subscription_ratio = 20.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] message_reap_interval = 86400 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] message_ttl = 2592000 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] migration_create_volume_timeout_secs = 300 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] monkey_patch = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] monkey_patch_modules = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] my_ip = 192.168.122.246 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] no_snapshot_gb_quota = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] num_iser_scan_tries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] num_shell_tries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] num_volume_device_scan_tries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] nvmeof_conn_info_version = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] nvmet_ns_id = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] nvmet_port_id = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] osapi_max_limit = 1000 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] osapi_volume_ext_list = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] osapi_volume_listen_port = 8776 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] osapi_volume_use_ssl = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] osapi_volume_workers = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] per_volume_size_limit = -1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] periodic_fuzzy_delay = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] periodic_interval = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] public_endpoint = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] publish_errors = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] quota_backup_gigabytes = 1000 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] quota_backups = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] quota_gigabytes = 1000 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] quota_groups = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] quota_snapshots = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] quota_volumes = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] rate_limit_burst = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] rate_limit_except_level = CRITICAL {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] rate_limit_interval = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] reinit_driver_count = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] replication_device = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76780]: INFO cinder.volume.manager [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] report_discard_supported = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] report_interval = 120 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] reservation_clean_interval = 86400 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] reservation_expire = 86400 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] reserved_image_namespaces = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] reserved_percentage = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] rpc_response_timeout = 120 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] run_external_periodic_tasks = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] scst_target_driver = iscsi {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] scst_target_iqn_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_down_time = 720 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] shell_completion = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] snapshot_name_template = snapshot-%s {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] snapshot_same_host = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] split_loggers = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] state_path = /opt/stack/data/cinder {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] storage_availability_zone = nova {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] storage_protocol = iSCSI {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] syslog_log_facility = LOG_USER {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] target_helper = lioadm {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] target_ip_address = 192.168.122.246 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] target_port = 3260 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] target_protocol = iscsi {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] target_secondary_ip_addresses = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] trace_flags = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] transport_url = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] until_refresh = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] use_chap_auth = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] use_default_quota_class = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] use_journal = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] use_json = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] use_multipath_for_image_xfer = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] use_stderr = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] use_syslog = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] verify_glance_signatures = enabled {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_api_class = cinder.volume.api.API {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_backend_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_clear = zero {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_clear_ionice = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_clear_size = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_copy_bps_limit = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_dd_blocksize = 1M {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_name_template = volume-%s {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_service_inithost_offload = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volume_usage_audit_period = month {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] zoning_mode = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_concurrency.disable_process_locking = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.auth_section = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.auth_type = password {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.auth_version = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.cache = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.include_service_catalog = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.insecure = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.interface = public {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_password = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcache_username = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.region_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.service_type = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.backend = dogpile.cache.null {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.backend_argument = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.backend_expiration_time = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.config_prefix = cache.oslo {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.debug_cache_backend = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.enable_retry_client = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.enable_socket_keepalive = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.expiration_time = 600 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.hashclient_retry_attempts = 2 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.memcache_dead_retry = 300 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.memcache_pool_maxsize = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.memcache_sasl_enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.password = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.proxies = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.redis_db = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.redis_server = localhost:6379 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.retry_attempts = 2 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.retry_delay = 0.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.socket_keepalive_count = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.socket_keepalive_idle = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.socket_keepalive_interval = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.socket_timeout = 1.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.tls_allowed_ciphers = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.tls_cafile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.tls_certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.tls_enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.tls_keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cache.username = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] coordination.backend_url = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.asyncio_connection = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.asyncio_slave_connection = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.backend = sqlalchemy {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.connection = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.connection_debug = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.connection_parameters = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.connection_recycle_time = 3600 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.connection_trace = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.db_inc_retry_interval = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.db_max_retries = 20 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.db_max_retry_interval = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.db_retry_interval = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.max_overflow = 50 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.max_pool_size = 5 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.max_retries = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.mysql_wsrep_sync_wait = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.pool_timeout = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.retry_interval = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.slave_connection = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.sqlite_synchronous = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.synchronous_reader = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] database.use_db_reconnect = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.connection_string = messaging:// {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.es_doc_type = notification {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.es_scroll_size = 10000 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.es_scroll_time = 2m {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.filter_error_trace = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.hmac_keys = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.sentinel_service_name = mymaster {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.socket_timeout = 0.1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.trace_requests = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler.trace_sqlalchemy = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler_jaeger.process_tags = {} {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler_jaeger.service_name_prefix = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] profiler_otlp.service_name_prefix = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.enforce_new_defaults = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.policy_default_rule = default {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.policy_file = policy.yaml {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] privsep_osbrick.group = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] privsep_osbrick.helper_command = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] privsep_osbrick.user = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_sys_admin.group = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_sys_admin.helper_command = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] cinder_sys_admin.user = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.auth_section = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.auth_type = password {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.cafile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.collect_timing = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.insecure = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.send_service_user_token = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.split_loggers = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] service_user.timeout = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.auth_section = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.auth_type = password {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.collect_timing = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.insecure = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.region_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.split_loggers = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] glance.timeout = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.backend_availability_zone = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.chap_password = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.chap_username = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.disk_geometry = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.driver_client_cert = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.driver_client_cert_key = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.driver_data_namespace = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.driver_use_ssl = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.extra_capabilities = {} {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.filter_function = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.goodness_function = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.iscsi_target_flags = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.iscsi_write_cache = on {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.iser_helper = tgtadm {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.iser_port = 3260 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.lvm_share_target = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.lvm_type = auto {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.num_shell_tries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.replication_device = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.report_discard_supported = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.reserved_percentage = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.target_helper = tgtadm {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.target_port = 3260 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.target_protocol = iscsi {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.trace_flags = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.unique_fqdn_network = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.use_chap_auth = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_backend_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_clear = zero {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_clear_ionice = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_clear_size = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_reports.file_event_handler = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_reports.log_dir = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.backend_host = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.chap_password = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.chap_username = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.disk_geometry = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.driver_client_cert = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.extra_capabilities = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.filter_function = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.goodness_function = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack sudo[76810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.iser_helper = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.iser_ip_address = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.iser_port = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack sudo[76810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.lvm_share_target = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.lvm_type = auto {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.num_shell_tries = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.replication_device = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.report_discard_supported = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.reserved_percentage = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.scst_target_driver = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.storage_protocol = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.target_helper = lioadm {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.target_ip_address = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.target_port = 3260 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.trace_flags = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.use_chap_auth = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_clear = zero {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_clear_size = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] lvmdriver-1.volumes_dir = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.ssl = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_notifications.driver = [] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_notifications.retry = -1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] key_manager.fixed_key = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.barbican_api_version = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.barbican_endpoint = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.barbican_endpoint_type = public {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.barbican_region_name = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.cafile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.collect_timing = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.insecure = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.number_of_retries = 60 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.retry_delay = 1 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.send_service_user_token = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.split_loggers = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.timeout = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.verify_ssl = True {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican.verify_ssl_path = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.auth_section = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.auth_type = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.cafile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.certfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.collect_timing = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.insecure = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.keyfile = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.split_loggers = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] barbican_service_user.timeout = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.approle_role_id = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.approle_secret_id = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.auth_method = approle {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.auth_path = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.kv_mountpoint = secret {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.kv_path = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.kv_version = 2 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.namespace = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.root_token_id = **** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.ssl_ca_crt_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.timeout = 60.0 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.token_file = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.token_role = None {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.use_ssl = False {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:29:26 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] ******************************************************************************** {{(pid=76636) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 20:29:26 devstack sudo[76810]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:26 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:26 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:26 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:27 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.277s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:29:27 devstack cinder-volume[76780]: INFO cinder.brick.local_dev.lvm [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:27 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:29:27 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:27 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG cinder.brick.local_dev.lvm [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76780) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:27 devstack sudo[77118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:27 devstack sudo[77118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:27 devstack sudo[77118]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:27 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:27 devstack sudo[77299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:27 devstack sudo[77299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:28 devstack sudo[77299]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:28 devstack sudo[77389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 22 20:29:28 devstack sudo[77389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:28 devstack sudo[77389]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:28 devstack sudo[77392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:29:28 devstack sudo[77392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:28 devstack sudo[77392]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:28 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:28 devstack sudo[77475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:29:28 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:29 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:29 devstack sudo[77478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:29:29 devstack sudo[77478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:29 devstack sudo[77478]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:29 devstack sudo[77510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:29 devstack sudo[77510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:29 devstack sudo[77510]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.360s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:29 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:29 devstack sudo[77571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:29 devstack sudo[77571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:30 devstack sudo[77571]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:30 devstack cinder-volume[76780]: INFO cinder.volume.drivers.lvm [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:30 devstack sudo[77576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:30 devstack sudo[77576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:30 devstack sudo[77576]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG cinder.volume.drivers.lvm [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Updating volume stats {{(pid=76780) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:30 devstack sudo[77585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:29:30 devstack sudo[77585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:30 devstack sudo[77585]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:30 devstack sudo[77588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:29:30 devstack sudo[77588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:30 devstack sudo[77588]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:30 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:30 devstack sudo[77591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:30 devstack sudo[77591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:31 devstack sudo[77591]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:31 devstack sudo[77595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:29:31 devstack sudo[77595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:31 devstack sudo[77595]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:31 devstack cinder-volume[76780]: INFO cinder.volume.driver [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Driver hasn't implemented _init_vendor_properties() Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG cinder.volume.driver [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76780) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76780) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG dbcounter [-] [76780] Writer thread running {{(pid=76780) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG cinder.db.api [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Building query based on filter {{(pid=76780) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG cinder.image.image_utils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76780) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 20:29:31 devstack cinder-volume[76780]: INFO cinder.keymgr.migration [None req-8bab1c71-db0b-43e6-a9d3-79c0d34ff061 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG cinder.volume.drivers.lvm [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Updating volume stats {{(pid=76780) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:31 devstack sudo[77599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:29:31 devstack sudo[77599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:31 devstack sudo[77599]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:31 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:31 devstack sudo[77603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:29:31 devstack sudo[77603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:32 devstack sudo[77603]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:32 devstack sudo[77606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:32 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:32 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:32 devstack sudo[77609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:29:32 devstack sudo[77609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:32 devstack sudo[77609]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG cinder.manager [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Notifying Schedulers of capabilities ... {{(pid=76780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:29:32 devstack cinder-volume[76780]: INFO cinder.volume.manager [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Driver initialization completed successfully. Jul 22 20:29:32 devstack cinder-volume[76780]: INFO cinder.manager [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Initiating service 2 cleanup Jul 22 20:29:32 devstack cinder-volume[76780]: INFO cinder.manager [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Service 2 cleanup completed. Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG cinder.service [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Creating RPC server for service cinder-volume {{(pid=76780) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG cinder.service [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76780) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 20:29:32 devstack cinder-volume[76780]: INFO cinder.volume.manager [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG cinder.volume.drivers.lvm [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Updating volume stats {{(pid=76780) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 20:29:32 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:32 devstack sudo[77614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:29:32 devstack sudo[77614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:33 devstack sudo[77614]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:33 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:33 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:33 devstack sudo[77617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:29:33 devstack sudo[77617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:33 devstack sudo[77617]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:33 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:33 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:33 devstack sudo[77620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:29:33 devstack sudo[77620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:33 devstack sudo[77620]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:33 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:33 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:29:33 devstack sudo[77626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:29:33 devstack sudo[77626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:29:33 devstack sudo[77626]: pam_unix(sudo:session): session closed for user root Jul 22 20:29:33 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:29:33 devstack cinder-volume[76780]: INFO cinder.volume.manager [None req-6fb3db88-9fe7-41da-a3cb-0de47d10f174 None None] Driver post RPC initialization completed successfully. Jul 22 20:29:36 devstack cinder-volume[76636]: DEBUG dbcounter [-] [76636] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76636) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:29:42 devstack cinder-volume[76780]: DEBUG dbcounter [-] [76780] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76780) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:29:43 devstack cinder-volume[76780]: DEBUG dbcounter [-] [76780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76780) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:30:06 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager._thread_info {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:30:06 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread count: 6 {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:30:06 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread info: [<_MainThread(MainThread, started 138993761964160)>, , , , , ] {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:31:06 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:31:06 devstack cinder-volume[76780]: DEBUG cinder.volume.drivers.lvm [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Updating volume stats {{(pid=76780) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 20:31:06 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:31:06 devstack sudo[80460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:31:06 devstack sudo[80460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:31:07 devstack sudo[80460]: pam_unix(sudo:session): session closed for user root Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:31:07 devstack sudo[80598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:31:07 devstack sudo[80598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:31:07 devstack sudo[80598]: pam_unix(sudo:session): session closed for user root Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:31:07 devstack sudo[80752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:31:07 devstack sudo[80752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:31:07 devstack sudo[80752]: pam_unix(sudo:session): session closed for user root Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:31:07 devstack sudo[80885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:31:07 devstack sudo[80885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:31:07 devstack sudo[80885]: pam_unix(sudo:session): session closed for user root Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG cinder.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Notifying Schedulers of capabilities ... {{(pid=76780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager._thread_info {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread count: 6 {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:31:07 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread info: [<_MainThread(MainThread, started 138993761964160)>, , , , , ] {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:31:43 devstack cinder-volume[76780]: DEBUG dbcounter [-] [76780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76780) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:32:06 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:32:06 devstack cinder-volume[76780]: DEBUG cinder.volume.drivers.lvm [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Updating volume stats {{(pid=76780) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 20:32:06 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:32:06 devstack sudo[84025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:32:06 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:32:07 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:32:07 devstack sudo[84066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:32:07 devstack sudo[84066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:32:07 devstack sudo[84066]: pam_unix(sudo:session): session closed for user root Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:32:07 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:32:07 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:32:07 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:32:07 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:32:07 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:32:07 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:32:07 devstack cinder-volume[76780]: DEBUG cinder.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Notifying Schedulers of capabilities ... {{(pid=76780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:33:06 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:33:06 devstack cinder-volume[76780]: DEBUG cinder.volume.drivers.lvm [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Updating volume stats {{(pid=76780) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 20:33:06 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:33:06 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:33:06 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:33:07 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:33:07 devstack sudo[85685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:33:07 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:33:07 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:33:07 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:33:07 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:33:07 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:33:07 devstack sudo[85692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:33:07 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:33:07 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG cinder.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Notifying Schedulers of capabilities ... {{(pid=76780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager._thread_info {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread count: 6 {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:33:07 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread info: [<_MainThread(MainThread, started 138993761964160)>, , , , , ] {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:33:43 devstack cinder-volume[76780]: DEBUG dbcounter [-] [76780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76780) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:33:59 devstack cinder-volume[76636]: INFO oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Caught SIGTERM, stopping children Jul 22 20:33:59 devstack cinder-volume[76636]: DEBUG oslo_concurrency.lockutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Acquiring lock "singleton_lock" {{(pid=76636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 20:33:59 devstack cinder-volume[76636]: DEBUG oslo_concurrency.lockutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Acquired lock "singleton_lock" {{(pid=76636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 20:33:59 devstack cinder-volume[76636]: DEBUG oslo_concurrency.lockutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Releasing lock "singleton_lock" {{(pid=76636) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 20:33:59 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Stop services. {{(pid=76636) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 20:33:59 devstack cinder-volume[76636]: DEBUG oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Killing children. {{(pid=76636) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 20:33:59 devstack cinder-volume[76636]: INFO oslo_service.backend._eventlet.service [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Waiting on 1 children to exit Jul 22 20:34:04 devstack cinder-volume[76780]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 22 20:34:04 devstack cinder-volume[86843]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 20:34:04 devstack cinder-volume[86843]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 20:34:04 devstack cinder-volume[86843]: we strongly recommend against using it for new projects. Jul 22 20:34:04 devstack cinder-volume[86843]: If you are already using Eventlet, we recommend migrating to a different Jul 22 20:34:04 devstack cinder-volume[86843]: framework. For more detail see Jul 22 20:34:04 devstack cinder-volume[86843]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 20:34:04 devstack cinder-volume[86843]: import eventlet # noqa Jul 22 20:34:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 20:34:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 20:34:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 20:34:06 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:34:06 devstack cinder-volume[76780]: DEBUG cinder.volume.drivers.lvm [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Updating volume stats {{(pid=76780) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 20:34:06 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:06 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 20:34:06 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:07 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:07 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:34:07 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:07 devstack cinder-volume[86843]: INFO dbcounter [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Registered counter for database cinder Jul 22 20:34:07 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:07 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:07 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:07 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 20:34:07 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:08 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writer thread running {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 20:34:08 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 20:34:08 devstack cinder-volume[86843]: INFO cinder.rpc [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 20:34:08 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:08 devstack cinder-volume[86843]: INFO cinder.rpc [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:08 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Determined volume DB was empty at startup. Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86843) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 20:34:08 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 20:34:08 devstack cinder-volume[86843]: WARNING stevedore.named [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 20:34:08 devstack cinder-volume[86843]: WARNING castellan.key_manager [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 20:34:08 devstack cinder-volume[86843]: WARNING cinder.keymgr.conf_key_mgr [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 20:34:08 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 20:34:08 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG oslo_concurrency.processutils [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=76780) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG cinder.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Notifying Schedulers of capabilities ... {{(pid=76780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG oslo_service.periodic_task [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] Running periodic task VolumeManager._thread_info {{(pid=76780) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread count: 5 {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG cinder.volume.manager [None req-4f311e32-44da-4d9f-bbda-f09927f6f183 None None] thread info: [<_MainThread(MainThread, started 138993761964160)>, , , , ] {{(pid=76780) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG oslo_concurrency.lockutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Acquiring lock "singleton_lock" {{(pid=76780) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG oslo_concurrency.lockutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Acquired lock "singleton_lock" {{(pid=76780) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 20:34:08 devstack cinder-volume[76780]: DEBUG oslo_concurrency.lockutils [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Releasing lock "singleton_lock" {{(pid=76780) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:08 devstack cinder-volume[76780]: WARNING amqp [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 20:34:08 devstack cinder-volume[76780]: WARNING amqp [None req-39e692c8-cf81-402c-9107-be3e1a8b1da0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 20:34:08 devstack cinder-volume[86843]: INFO oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Starting 1 workers Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Started child 87084 {{(pid=86843) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Full set of CONF: {{(pid=86843) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] ******************************************************************************** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Configuration options gathered from: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] ================================================================================ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] allow_availability_zone_fallback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] allow_compression_on_image_upload = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] allowed_direct_url_schemes = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] api_rate_limit = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] auth_strategy = keystone {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_stats_polling_interval = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backup_api_class = cinder.backup.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backup_name_template = backup-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backup_use_same_host = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backup_use_temp_snapshot = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] chap_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_internal_tenant_project_id = 7fcb14ecfba64f29bdee5fcd12f75da2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_internal_tenant_user_id = b6454331e1db44f4a9576ab5b6eeb042 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cluster = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] compression_format = gzip {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] compute_api_class = cinder.compute.nova.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] config_dir = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] config_source = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] control_exchange = openstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] debug = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] default_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] default_group_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[87084]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] default_volume_type = QuobyteHD {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] driver_ssl_cert_verify = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] driver_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] enable_new_services = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] enable_unsupported_driver = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] enabled_backends = ['QuobyteHD'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] enforce_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_api_insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_api_ssl_compression = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_ca_certificates_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_catalog_info = image:glance:publicURL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_num_retries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance_request_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] graceful_shutdown_timeout = 5 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] group_api_class = cinder.group.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] host = devstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_compress_on_upload = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_conversion_address_space_limit = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_conversion_cpu_limit = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_conversion_disable = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_upload_use_cinder_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_upload_use_internal_tenant = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_volume_cache_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_volume_cache_max_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] image_volume_cache_max_size_gb = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] init_host_max_objects_retrieval = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] instance_format = [instance: %(uuid)s] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] iscsi_target_flags = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] iscsi_write_cache = on {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] iser_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] iser_ip_address = 192.168.122.246 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] iser_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_color = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_config_append = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_options = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_rotate_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_rotate_interval_type = days {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] log_rotation_type = none {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] max_age = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] max_logfile_count = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] max_logfile_size_mb = 200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] max_over_subscription_ratio = 20.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] message_reap_interval = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] message_ttl = 2592000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] migration_create_volume_timeout_secs = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] monkey_patch = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] monkey_patch_modules = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] my_ip = 192.168.122.246 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] no_snapshot_gb_quota = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] num_iser_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] num_shell_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] num_volume_device_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] nvmeof_conn_info_version = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] nvmet_ns_id = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] nvmet_port_id = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] osapi_max_limit = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] osapi_volume_ext_list = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] osapi_volume_listen_port = 8776 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] osapi_volume_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] osapi_volume_workers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] per_volume_size_limit = -1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] periodic_fuzzy_delay = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] periodic_interval = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] public_endpoint = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] publish_errors = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] quota_backup_gigabytes = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] quota_backups = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] quota_gigabytes = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] quota_groups = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] quota_snapshots = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] quota_volumes = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] rate_limit_burst = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] rate_limit_except_level = CRITICAL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] rate_limit_interval = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] reinit_driver_count = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] report_discard_supported = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] report_interval = 120 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] reservation_clean_interval = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] reservation_expire = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] reserved_image_namespaces = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] reserved_percentage = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] rpc_response_timeout = 120 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] run_external_periodic_tasks = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] scst_target_driver = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_down_time = 720 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] shell_completion = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] snapshot_name_template = snapshot-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] state_path = /opt/stack/data/cinder {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] storage_availability_zone = nova {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] storage_protocol = iSCSI {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] syslog_log_facility = LOG_USER {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] target_helper = lioadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] target_ip_address = 192.168.122.246 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] target_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] target_protocol = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] target_secondary_ip_addresses = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] transport_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] until_refresh = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] use_chap_auth = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] use_default_quota_class = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] use_journal = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] use_json = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] use_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] use_stderr = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] use_syslog = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] verify_glance_signatures = enabled {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_api_class = cinder.volume.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_clear = zero {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_clear_size = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_copy_bps_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_dd_blocksize = 1M {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_name_template = volume-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_service_inithost_offload = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volume_usage_audit_period = month {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] zoning_mode = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_concurrency.disable_process_locking = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.auth_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.include_service_catalog = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.interface = public {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_password = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcache_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.service_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.backend = dogpile.cache.null {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.backend_argument = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.backend_expiration_time = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.config_prefix = cache.oslo {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.debug_cache_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.enable_retry_client = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.enable_socket_keepalive = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.expiration_time = 600 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.hashclient_retry_attempts = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.memcache_dead_retry = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.memcache_pool_maxsize = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.memcache_sasl_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.proxies = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.redis_db = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.redis_server = localhost:6379 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.retry_attempts = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.retry_delay = 0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.socket_keepalive_count = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.socket_keepalive_idle = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.socket_keepalive_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.socket_timeout = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.tls_allowed_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.tls_cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.tls_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.tls_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.tls_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cache.username = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] coordination.backend_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.asyncio_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.asyncio_slave_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.backend = sqlalchemy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.connection_debug = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.connection_parameters = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.connection_recycle_time = 3600 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.connection_trace = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.db_inc_retry_interval = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.db_max_retries = 20 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.db_max_retry_interval = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.db_retry_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Starting volume driver QuobyteDriver (1.2) Jul 22 20:34:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87084) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.max_overflow = 50 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.max_pool_size = 5 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.max_retries = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.mysql_wsrep_sync_wait = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.pool_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.retry_interval = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.slave_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.sqlite_synchronous = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.synchronous_reader = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] database.use_db_reconnect = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.connection_string = messaging:// {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.es_doc_type = notification {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.es_scroll_size = 10000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.es_scroll_time = 2m {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.filter_error_trace = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.hmac_keys = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.sentinel_service_name = mymaster {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.socket_timeout = 0.1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.trace_requests = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler.trace_sqlalchemy = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler_jaeger.process_tags = {} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler_jaeger.service_name_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] profiler_otlp.service_name_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.enforce_new_defaults = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.policy_default_rule = default {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.policy_file = policy.yaml {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] privsep_osbrick.group = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] privsep_osbrick.helper_command = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] privsep_osbrick.user = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_sys_admin.group = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_sys_admin.helper_command = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] cinder_sys_admin.user = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.send_service_user_token = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] service_user.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] glance.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.chap_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.driver_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.extra_capabilities = {} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.iscsi_target_flags = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.iscsi_write_cache = on {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.iser_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.iser_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_host = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_login = admin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_mount_options = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_private_key = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_share_path = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.num_shell_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.quobyte_volume_url = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.report_discard_supported = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.reserved_percentage = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.target_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.target_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.target_protocol = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.unique_fqdn_network = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.use_chap_auth = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_clear = zero {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_clear_size = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_reports.file_event_handler = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_reports.log_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.backend_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.chap_username = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.chiscsi_conf = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.driver_use_ssl = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.extra_capabilities = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87084) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 20:34:08 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.iser_helper = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.iser_ip_address = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.iser_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.iser_target_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:08 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_login = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_mount_options = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_private_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Running cmd (subprocess): mount.quobyte {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_share_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_ssh_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.num_shell_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.nvmet_port_id = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.report_discard_supported = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.reserved_percentage = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.scst_target_driver = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.storage_protocol = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.target_helper = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.target_ip_address = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.target_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.target_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.target_protocol = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.use_chap_auth = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_clear = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_clear_size = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] QuobyteHD.volumes_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_notifications.driver = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_notifications.retry = -1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] key_manager.fixed_key = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.barbican_api_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.barbican_endpoint = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.barbican_endpoint_type = public {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.barbican_region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.number_of_retries = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.retry_delay = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.send_service_user_token = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.verify_ssl = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican.verify_ssl_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.auth_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] barbican_service_user.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.approle_role_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.approle_secret_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.auth_method = approle {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.auth_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.kv_mountpoint = secret {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.kv_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.kv_version = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.root_token_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.ssl_ca_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.token_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.token_role = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] ******************************************************************************** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:09 devstack cinder-volume[87084]: INFO cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 ... Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 -c /etc/quobyte/client-cinder.cfg {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:09 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 -c /etc/quobyte/client-cinder.cfg Jul 22 20:34:09 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:09 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:09 devstack cinder-volume[87084]: INFO cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 succeeded Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.410s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:09 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:09 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:09 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:09 devstack cinder-volume[87084]: INFO cinder.volume.driver [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Driver hasn't implemented _init_vendor_properties() Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG cinder.volume.driver [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_db.sqlalchemy.engines [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writer thread running {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG cinder.db.api [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Building query based on filter {{(pid=87084) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87084) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 20:34:09 devstack cinder-volume[87084]: INFO cinder.keymgr.migration [None req-d1841da1-ea03-4347-9dca-5ced15d6a24f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:10 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:10 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:10 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.318s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:34:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Driver initialization completed successfully. Jul 22 20:34:10 devstack cinder-volume[87084]: INFO cinder.manager [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Initiating service 3 cleanup Jul 22 20:34:10 devstack cinder-volume[87084]: INFO cinder.manager [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Service 3 cleanup completed. Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG cinder.service [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Creating RPC server for service cinder-volume {{(pid=87084) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG cinder.service [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87084) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 20:34:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:10 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:10 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:10 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ccc0d636-a19b-460d-9abc-b79688155b4f None None] Driver post RPC initialization completed successfully. Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:14 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:14 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:14 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.228s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-be351f8b-d2a6-4dfb-a1a0-b45e2325c39d None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:34:17 devstack cinder-volume[86843]: INFO oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Caught SIGTERM, stopping children Jul 22 20:34:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Acquiring lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 20:34:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Acquired lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 20:34:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Releasing lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 20:34:17 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Stop services. {{(pid=86843) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 20:34:17 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Killing children. {{(pid=86843) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 20:34:17 devstack cinder-volume[86843]: INFO oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Waiting on 1 children to exit Jul 22 20:34:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Acquiring lock "singleton_lock" {{(pid=87084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 20:34:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Acquired lock "singleton_lock" {{(pid=87084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 20:34:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Releasing lock "singleton_lock" {{(pid=87084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 20:34:18 devstack cinder-volume[87084]: WARNING amqp [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 20:34:18 devstack cinder-volume[87084]: WARNING amqp [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 20:34:18 devstack cinder-volume[86843]: INFO oslo_service.backend._eventlet.service [None req-58c978f5-1de8-4b2d-8891-72cb41721301 None None] Child 87084 exited with status 0 Jul 22 20:34:19 devstack cinder-volume[87499]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 20:34:19 devstack cinder-volume[87499]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 20:34:19 devstack cinder-volume[87499]: we strongly recommend against using it for new projects. Jul 22 20:34:19 devstack cinder-volume[87499]: If you are already using Eventlet, we recommend migrating to a different Jul 22 20:34:19 devstack cinder-volume[87499]: framework. For more detail see Jul 22 20:34:19 devstack cinder-volume[87499]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 20:34:19 devstack cinder-volume[87499]: import eventlet # noqa Jul 22 20:34:22 devstack cinder-volume[87499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 20:34:22 devstack cinder-volume[87499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 20:34:22 devstack cinder-volume[87499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 20:34:23 devstack cinder-volume[87499]: INFO dbcounter [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Registered counter for database cinder Jul 22 20:34:23 devstack cinder-volume[87499]: DEBUG oslo_db.sqlalchemy.engines [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:23 devstack cinder-volume[87499]: DEBUG dbcounter [-] [87499] Writer thread running {{(pid=87499) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 20:34:23 devstack cinder-volume[87499]: INFO cinder.rpc [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 20:34:23 devstack cinder-volume[87499]: INFO cinder.rpc [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_db.sqlalchemy.engines [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:24 devstack cinder-volume[87499]: INFO cinder.volume.manager [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Determined volume DB was empty at startup. Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG cinder.volume.manager [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87499) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 20:34:24 devstack cinder-volume[87499]: WARNING stevedore.named [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 20:34:24 devstack cinder-volume[87499]: WARNING castellan.key_manager [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 20:34:24 devstack cinder-volume[87499]: WARNING cinder.keymgr.conf_key_mgr [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 20:34:24 devstack cinder-volume[87499]: INFO cinder.volume.manager [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_db.sqlalchemy.engines [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:24 devstack cinder-volume[87499]: INFO oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Starting 1 workers Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Started child 87818 {{(pid=87499) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Full set of CONF: {{(pid=87499) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] ******************************************************************************** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] Configuration options gathered from: {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] ================================================================================ {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] allow_availability_zone_fallback = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] allow_compression_on_image_upload = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] allowed_direct_url_schemes = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] api_rate_limit = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] auth_strategy = keystone {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87818]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_availability_zone = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_host = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_stats_polling_interval = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backup_api_class = cinder.backup.api.API {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backup_name_template = backup-%s {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backup_use_same_host = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backup_use_temp_snapshot = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] chap_password = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] chap_username = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_internal_tenant_project_id = 7fcb14ecfba64f29bdee5fcd12f75da2 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_internal_tenant_user_id = b6454331e1db44f4a9576ab5b6eeb042 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cluster = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] compression_format = gzip {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] config_dir = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] config_source = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] control_exchange = openstack {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] debug = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] default_availability_zone = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] default_group_type = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] default_volume_type = QuobyteHD {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] disk_geometry = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] driver_client_cert = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] driver_client_cert_key = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] driver_data_namespace = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] driver_ssl_cert_path = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] driver_ssl_cert_verify = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] driver_use_ssl = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] enable_new_services = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] enable_unsupported_driver = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] enabled_backends = ['QuobyteHD'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] enforce_multipath_for_image_xfer = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] filter_function = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_api_insecure = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_api_servers = ['http://192.168.122.246/image'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_api_ssl_compression = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_ca_certificates_file = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_num_retries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance_request_timeout = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] goodness_function = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] graceful_shutdown_timeout = 5 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] group_api_class = cinder.group.api.API {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] host = devstack {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_compress_on_upload = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_conversion_address_space_limit = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_conversion_cpu_limit = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_conversion_disable = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_upload_use_cinder_backend = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_upload_use_internal_tenant = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_volume_cache_enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_volume_cache_max_count = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] init_host_max_objects_retrieval = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] instance_format = [instance: %(uuid)s] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] iscsi_target_flags = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] iscsi_write_cache = on {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] iser_helper = tgtadm {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] iser_ip_address = 192.168.122.246 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] iser_port = 3260 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_color = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_config_append = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_dir = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_file = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_options = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_rotate_interval = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_rotate_interval_type = days {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] log_rotation_type = none {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] max_age = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] max_logfile_count = 30 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] max_logfile_size_mb = 200 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] max_over_subscription_ratio = 20.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] message_reap_interval = 86400 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] message_ttl = 2592000 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] monkey_patch = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] monkey_patch_modules = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] my_ip = 192.168.122.246 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] no_snapshot_gb_quota = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] num_iser_scan_tries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] num_shell_tries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] num_volume_device_scan_tries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] nvmeof_conn_info_version = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] nvmet_ns_id = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Starting volume driver QuobyteDriver (1.2) Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87818) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] nvmet_port_id = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] osapi_max_limit = 1000 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] osapi_volume_ext_list = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] osapi_volume_listen_port = 8776 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] osapi_volume_use_ssl = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] osapi_volume_workers = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] per_volume_size_limit = -1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] periodic_fuzzy_delay = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] periodic_interval = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] public_endpoint = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] publish_errors = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] quota_backup_gigabytes = 1000 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] quota_backups = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] quota_gigabytes = 1000 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] quota_groups = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] quota_snapshots = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] quota_volumes = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] rate_limit_burst = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] rate_limit_except_level = CRITICAL {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] rate_limit_interval = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] reinit_driver_count = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] replication_device = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] report_discard_supported = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] report_interval = 120 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] reservation_clean_interval = 86400 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] reservation_expire = 86400 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] reserved_image_namespaces = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] reserved_percentage = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] rpc_response_timeout = 120 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] run_external_periodic_tasks = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] scst_target_driver = iscsi {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] scst_target_iqn_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_down_time = 720 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] shell_completion = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] snapshot_name_template = snapshot-%s {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] split_loggers = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] state_path = /opt/stack/data/cinder {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] storage_availability_zone = nova {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] storage_protocol = iSCSI {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] syslog_log_facility = LOG_USER {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] target_helper = lioadm {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] target_ip_address = 192.168.122.246 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] target_port = 3260 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] target_protocol = iscsi {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] target_secondary_ip_addresses = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] trace_flags = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] transport_url = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] until_refresh = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] use_chap_auth = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] use_default_quota_class = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] use_journal = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] use_json = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] use_multipath_for_image_xfer = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] use_stderr = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] use_syslog = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] verify_glance_signatures = enabled {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_api_class = cinder.volume.api.API {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_backend_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_clear = zero {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_clear_ionice = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_clear_size = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_copy_bps_limit = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_dd_blocksize = 1M {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_name_template = volume-%s {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_service_inithost_offload = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volume_usage_audit_period = month {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] zoning_mode = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.auth_section = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.auth_type = password {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.auth_version = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.cache = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.insecure = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.interface = public {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_password = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcache_username = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.region_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.service_type = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.backend = dogpile.cache.null {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.backend_argument = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.backend_expiration_time = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.config_prefix = cache.oslo {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.debug_cache_backend = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.enable_retry_client = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.enable_socket_keepalive = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.expiration_time = 600 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.memcache_dead_retry = 300 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.memcache_sasl_enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.password = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.proxies = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.redis_db = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.redis_server = localhost:6379 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.retry_attempts = 2 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.retry_delay = 0.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.socket_keepalive_count = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.socket_keepalive_idle = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.socket_keepalive_interval = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.socket_timeout = 1.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.tls_allowed_ciphers = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.tls_cafile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.tls_certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.tls_enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.tls_keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cache.username = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] coordination.backend_url = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.asyncio_connection = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.asyncio_slave_connection = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.backend = sqlalchemy {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.connection = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.connection_debug = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.connection_parameters = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.connection_recycle_time = 3600 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87818) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 20:34:24 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 20:34:24 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Running cmd (subprocess): mount.quobyte {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.connection_trace = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.db_inc_retry_interval = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.db_max_retries = 20 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.db_max_retry_interval = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.db_retry_interval = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.max_overflow = 50 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.max_pool_size = 5 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.max_retries = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.pool_timeout = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.retry_interval = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.slave_connection = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.sqlite_synchronous = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.synchronous_reader = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] database.use_db_reconnect = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.connection_string = messaging:// {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.es_doc_type = notification {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.es_scroll_size = 10000 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.es_scroll_time = 2m {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.filter_error_trace = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.hmac_keys = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.sentinel_service_name = mymaster {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.socket_timeout = 0.1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.trace_requests = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler.trace_sqlalchemy = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler_jaeger.process_tags = {} {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] profiler_otlp.service_name_prefix = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.enforce_new_defaults = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.policy_default_rule = default {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] privsep_osbrick.group = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] privsep_osbrick.helper_command = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] privsep_osbrick.user = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_sys_admin.group = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_sys_admin.helper_command = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] cinder_sys_admin.user = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.auth_section = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.auth_type = password {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.cafile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.collect_timing = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.insecure = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.send_service_user_token = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.split_loggers = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] service_user.timeout = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.auth_section = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.auth_type = password {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.collect_timing = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.insecure = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.region_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.split_loggers = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] glance.timeout = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.backend_availability_zone = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.chap_password = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.chap_username = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.disk_geometry = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.driver_client_cert = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.driver_data_namespace = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.driver_use_ssl = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.extra_capabilities = {} {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.filter_function = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.goodness_function = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.iscsi_target_flags = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.iser_port = 3260 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_host = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_login = admin {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_mount_options = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_password = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_private_key = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_share_path = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.quobyte_volume_url = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.replication_device = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.report_discard_supported = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.target_helper = tgtadm {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.target_port = 3260 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.target_protocol = iscsi {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.trace_flags = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.use_chap_auth = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_backend_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_clear = zero {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_reports.file_event_handler = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_reports.log_dir = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.backend_availability_zone = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.backend_host = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.chap_password = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.chap_username = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.chiscsi_conf = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.disk_geometry = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] CMD "mount.quobyte" returned: 1 in 0.149s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.driver_client_cert = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.driver_data_namespace = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.driver_use_ssl = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.extra_capabilities = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.filter_function = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.goodness_function = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.iser_helper = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.iser_ip_address = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.iser_port = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.iser_target_prefix = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_host = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_login = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_mount_options = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_password = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_private_key = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_share_path = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_ssh_port = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.num_shell_tries = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.nvmet_port_id = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.replication_device = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.report_discard_supported = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.reserved_percentage = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.scst_target_driver = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.storage_protocol = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.target_helper = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.target_ip_address = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.target_port = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.target_prefix = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.target_protocol = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.trace_flags = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.use_chap_auth = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_clear = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_clear_size = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] QuobyteHD.volumes_dir = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_notifications.driver = [] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] key_manager.fixed_key = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.barbican_api_version = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.barbican_endpoint = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.barbican_endpoint_type = public {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.barbican_region_name = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.cafile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.collect_timing = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.insecure = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.number_of_retries = 60 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.retry_delay = 1 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.send_service_user_token = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.split_loggers = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.timeout = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.verify_ssl = True {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican.verify_ssl_path = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.auth_section = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.auth_type = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.cafile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.certfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.collect_timing = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.insecure = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.keyfile = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.split_loggers = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] barbican_service_user.timeout = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.approle_role_id = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.approle_secret_id = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.auth_method = approle {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.auth_path = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.kv_mountpoint = secret {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.kv_path = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.kv_version = 2 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.namespace = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.root_token_id = **** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.ssl_ca_crt_file = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.timeout = 60.0 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.token_file = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.token_role = None {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.use_ssl = False {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 20:34:24 devstack cinder-volume[87499]: DEBUG oslo_service.backend._eventlet.service [None req-bd78ae9f-f1e2-476d-b65c-bfb1ca3c21a2 None None] ******************************************************************************** {{(pid=87499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 20:34:25 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.343s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:25 devstack cinder-volume[87818]: INFO cinder.volume.driver [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Driver hasn't implemented _init_vendor_properties() Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.volume.driver [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87818) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_db.sqlalchemy.engines [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87818) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writer thread running {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.db.api [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Building query based on filter {{(pid=87818) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87818) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:25 devstack cinder-volume[87818]: INFO cinder.keymgr.migration [None req-7237dcf2-4f94-4e9d-9b8b-58767e304b10 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 20:34:25 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:25 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:25 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.299s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:34:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Driver initialization completed successfully. Jul 22 20:34:25 devstack cinder-volume[87818]: INFO cinder.manager [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Initiating service 3 cleanup Jul 22 20:34:25 devstack cinder-volume[87818]: INFO cinder.manager [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Service 3 cleanup completed. Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.service [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Creating RPC server for service cinder-volume {{(pid=87818) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.service [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87818) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 20:34:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:34:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:34:25 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:25 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:25 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:34:25 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:34:26 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.261s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3fb4d179-891b-4fbc-a589-f178ea7e6f4c None None] Driver post RPC initialization completed successfully. Jul 22 20:34:26 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Jul 22 20:34:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.268s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:34:26 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-0dc3e681-4a05-44da-84dc-6662eff63a03 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:34:34 devstack cinder-volume[87499]: DEBUG dbcounter [-] [87499] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87499) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:34:35 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=2 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:34:36 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:34:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:34:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 6 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:34:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Flow 'volume_create_manager' (23a8b8a7-b367-40b3-92f8-b1e7edafb96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c9ba98-3fed-492a-b62c-16db67396348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c9ba98-3fed-492a-b62c-16db67396348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-325869412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfe4561-79d2-446e-813a-5a441e039e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d0ff45ce3842c395317e3912f7f60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:35:35Z,use_quota=True,user_id='a77737ab445b435c8bbd27736d4a8c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e13cc4a-5f33-48f7-9eee-cc59501b7aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e13cc4a-5f33-48f7-9eee-cc59501b7aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e60955-af7a-4ae7-a831-a154e183be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e60955-af7a-4ae7-a831-a154e183be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfe4561-79d2-446e-813a-5a441e039e22', 'volume_name': 'volume-5dfe4561-79d2-446e-813a-5a441e039e22', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562b97c6-aff1-4fee-851e-d253cda58f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562b97c6-aff1-4fee-851e-d253cda58f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62098a60-55c7-48a7-b3be-6200c3782c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:35 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Volume 5dfe4561-79d2-446e-813a-5a441e039e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfe4561-79d2-446e-813a-5a441e039e22', 'volume_size': 1} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-325869412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfe4561-79d2-446e-813a-5a441e039e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d0ff45ce3842c395317e3912f7f60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:35:35Z,use_quota=True,user_id='a77737ab445b435c8bbd27736d4a8c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Creating volume 5dfe4561-79d2-446e-813a-5a441e039e22 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:35:35 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:35:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:35 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 1073741824 Jul 22 20:35:35 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:37 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 1073741824" returned: 0 in 2.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:37 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 Jul 22 20:35:37 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:38 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22" returned: 0 in 0.490s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] <== create_volume: return (2976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:35:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62098a60-55c7-48a7-b3be-6200c3782c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfe4561-79d2-446e-813a-5a441e039e22', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b879529-0240-40ef-869f-88ba32569eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:38 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Volume volume-5dfe4561-79d2-446e-813a-5a441e039e22 (5dfe4561-79d2-446e-813a-5a441e039e22): created successfully Jul 22 20:35:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b879529-0240-40ef-869f-88ba32569eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Flow 'volume_create_manager' (23a8b8a7-b367-40b3-92f8-b1e7edafb96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:35:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f8d84ade-241e-4b88-828e-eb2d666d38b6 tempest-DeleteServersTestJSON-645885877 None] Created volume successfully. Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:41 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:35:41 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Flow 'volume_create_manager' (1029f931-bde1-4570-9da0-026a4bdaf432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81efec8b-6f58-4b11-b323-48d1a27fbc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81efec8b-6f58-4b11-b323-48d1a27fbc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1212381218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e08725-67d2-4461-8421-3076fd30ea2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e8b96c31e2447fa4fc9ceb860fd4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:35:41Z,use_quota=True,user_id='13671d5e27994fdcbce3e12271838c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb41233-548a-48e8-b7ee-dfb54dda0b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb41233-548a-48e8-b7ee-dfb54dda0b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:41 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb870276-aa23-408f-ac87-b59fecf610f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb870276-aa23-408f-ac87-b59fecf610f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e08725-67d2-4461-8421-3076fd30ea2c', 'volume_name': 'volume-77e08725-67d2-4461-8421-3076fd30ea2c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d392b3-3705-49a5-957b-41e7b18fb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d392b3-3705-49a5-957b-41e7b18fb91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b524dc-f90d-4562-af47-45dd469ebf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Volume 77e08725-67d2-4461-8421-3076fd30ea2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e08725-67d2-4461-8421-3076fd30ea2c', 'volume_size': 1} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1212381218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e08725-67d2-4461-8421-3076fd30ea2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e8b96c31e2447fa4fc9ceb860fd4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:35:41Z,use_quota=True,user_id='13671d5e27994fdcbce3e12271838c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Creating volume 77e08725-67d2-4461-8421-3076fd30ea2c {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:35:42 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.909s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:35:42 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c 1073741824 Jul 22 20:35:42 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 6 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:35:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:35:43 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c 1073741824" returned: 0 in 1.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:43 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c Jul 22 20:35:43 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:44 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c" returned: 0 in 0.875s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:35:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b524dc-f90d-4562-af47-45dd469ebf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e08725-67d2-4461-8421-3076fd30ea2c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b514ca4-c6be-488e-86c2-6f93a681e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:35:44 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Volume volume-77e08725-67d2-4461-8421-3076fd30ea2c (77e08725-67d2-4461-8421-3076fd30ea2c): created successfully Jul 22 20:35:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b514ca4-c6be-488e-86c2-6f93a681e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:35:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Flow 'volume_create_manager' (1029f931-bde1-4570-9da0-026a4bdaf432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:35:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-128c3ff8-61b7-4e98-b13d-518e1b0b9a99 tempest-VolumesAdminNegativeTest-587447734 None] Created volume successfully. Jul 22 20:35:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Acquiring lock "cinder-77e08725-67d2-4461-8421-3076fd30ea2c-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:35:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Lock "cinder-77e08725-67d2-4461-8421-3076fd30ea2c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:35:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Acquiring lock "cinder-quobyte-77e08725-67d2-4461-8421-3076fd30ea2c" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:35:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Lock "cinder-quobyte-77e08725-67d2-4461-8421-3076fd30ea2c" acquired by "delete_volume" :: waited 0.050s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:35:45 devstack cinder-volume[87818]: INFO oslo.privsep.daemon [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmtlwmibp/privsep.sock'] Jul 22 20:35:45 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmtlwmibp/privsep.sock Jul 22 20:35:45 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:46 devstack cinder-volume[87818]: WARNING py.warnings [req-73c2e83d-e984-4d91-952a-63dbc68811b0 req-35079839-41f3-4e74-a60b-a3c18c78f69d tempest-DeleteServersTestJSON-645885877 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 22 20:35:46 devstack cinder-volume[87818]: .first() Jul 22 20:35:46 devstack cinder-volume[87818]: Jul 22 20:35:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-73c2e83d-e984-4d91-952a-63dbc68811b0 req-35079839-41f3-4e74-a60b-a3c18c78f69d tempest-DeleteServersTestJSON-645885877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-73c2e83d-e984-4d91-952a-63dbc68811b0 req-35079839-41f3-4e74-a60b-a3c18c78f69d tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-73c2e83d-e984-4d91-952a-63dbc68811b0 req-35079839-41f3-4e74-a60b-a3c18c78f69d tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-73c2e83d-e984-4d91-952a-63dbc68811b0 req-35079839-41f3-4e74-a60b-a3c18c78f69d tempest-DeleteServersTestJSON-645885877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-5dfe4561-79d2-446e-813a-5a441e039e22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22385d19-0054-498a-9411-61134f40d570', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:35:46 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-73c2e83d-e984-4d91-952a-63dbc68811b0 req-35079839-41f3-4e74-a60b-a3c18c78f69d tempest-DeleteServersTestJSON-645885877 None] attachment_update completed successfully. Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 20:35:48 devstack cinder-volume[87818]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 22 20:35:48 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:48 devstack cinder-volume[87818]: INFO oslo.privsep.daemon [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Spawned new privsep daemon via rootwrap Jul 22 20:35:48 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Accepted privsep connection to /tmp/tmpmtlwmibp/privsep.sock {{(pid=87818) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 22 20:35:48 devstack cinder-volume[87818]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 22 20:35:48 devstack cinder-volume[87818]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 22 20:35:48 devstack cinder-volume[87818]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 22 20:35:48 devstack cinder-volume[87818]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89258 Jul 22 20:35:49 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[72edb004-b3e5-4380-b200-3b6cc5347d30]: (2,) {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:35:49 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb8ae76-4cad-4b41-ac2a-030207392d7a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:35:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:49 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c Jul 22 20:35:49 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:50 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c" returned: 0 in 1.171s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:50 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c Jul 22 20:35:50 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:50 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-77e08725-67d2-4461-8421-3076fd30ea2c" returned: 0 in 0.693s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Lock "cinder-quobyte-77e08725-67d2-4461-8421-3076fd30ea2c" released by "delete_volume" :: held 5.148s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:35:51 devstack cinder-volume[87818]: WARNING cinder.quota [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:35:51 devstack cinder-volume[87818]: WARNING cinder.quota [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Created reservations ['ca1f18f2-6a34-4240-bece-67d08cdc5178', '995a76c7-42d5-4d66-8604-816d31298fc7', 'c797fe39-9bc3-490d-969b-e55edce1d981', '89eab737-9332-417a-befe-b6bc6450086f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:51 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:35:51 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:52 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 1.037s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:52 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:35:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Deleted volume successfully. Jul 22 20:35:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1552983a-1f38-4d70-aa80-ec8d4a5c1d97 tempest-VolumesAdminNegativeTest-587447734 None] Lock "cinder-77e08725-67d2-4461-8421-3076fd30ea2c-delete_volume" released by "delete_volume" :: held 6.908s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:35:56 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-6a3bdc28-e0db-4ac5-805e-9f4da01bc6f4 req-04df16d2-6b73-4066-82c6-c1f98f7ac73e tempest-DeleteServersTestJSON-645885877 None] Terminate volume connection completed successfully. Jul 22 20:35:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-6a3bdc28-e0db-4ac5-805e-9f4da01bc6f4 req-04df16d2-6b73-4066-82c6-c1f98f7ac73e tempest-DeleteServersTestJSON-645885877 None] Deleting attachment 22385d19-0054-498a-9411-61134f40d570. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Acquiring lock "cinder-5dfe4561-79d2-446e-813a-5a441e039e22-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Lock "cinder-5dfe4561-79d2-446e-813a-5a441e039e22-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Acquiring lock "cinder-quobyte-5dfe4561-79d2-446e-813a-5a441e039e22" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Lock "cinder-quobyte-5dfe4561-79d2-446e-813a-5a441e039e22" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81ffe1-1d6c-4c5f-b75a-7f612538f648]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:58 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 Jul 22 20:35:58 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:58 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22" returned: 0 in 0.437s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:58 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22 Jul 22 20:35:58 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:59 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5dfe4561-79d2-446e-813a-5a441e039e22" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Lock "cinder-quobyte-5dfe4561-79d2-446e-813a-5a441e039e22" released by "delete_volume" :: held 0.752s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Created reservations ['170b74f4-575e-4993-acf5-00b03a80a1ac', '1e7ac55a-8c77-4d00-a058-13d7048556eb', '24a09d24-9409-4932-ad3f-54474eb983c7', '3d64bd8e-1580-4497-9a5a-ab89ef43f815'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:35:59 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:35:59 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:35:59 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.329s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:35:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Deleted volume successfully. Jul 22 20:35:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d89cf662-61ba-444d-990d-2e35e0546e8b tempest-DeleteServersTestJSON-645885877 None] Lock "cinder-5dfe4561-79d2-446e-813a-5a441e039e22-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Flow 'volume_create_manager' (e6ec8a1b-d0b1-444c-9309-0e1cc48604fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35da956-6c06-431f-b9d2-b6eb9abcee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35da956-6c06-431f-b9d2-b6eb9abcee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1124768595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f777dac-2380-4cee-9588-8206bf6df504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca7970f7d94602abb39d542c105cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:36:05Z,use_quota=True,user_id='a0ce7e5587fc4e2a89c721c5cea0287e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8b9048-e7fa-4583-8cdd-fa51da4dcdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8b9048-e7fa-4583-8cdd-fa51da4dcdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00394f37-3461-47b4-b16a-55c617d8bc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00394f37-3461-47b4-b16a-55c617d8bc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f777dac-2380-4cee-9588-8206bf6df504', 'volume_name': 'volume-7f777dac-2380-4cee-9588-8206bf6df504', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9228e2-f899-42b4-9e78-5f0f9325bdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9228e2-f899-42b4-9e78-5f0f9325bdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d70739-d449-4af5-a7b3-2f6e726d47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Volume 7f777dac-2380-4cee-9588-8206bf6df504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f777dac-2380-4cee-9588-8206bf6df504', 'volume_size': 1} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1124768595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f777dac-2380-4cee-9588-8206bf6df504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca7970f7d94602abb39d542c105cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:36:05Z,use_quota=True,user_id='a0ce7e5587fc4e2a89c721c5cea0287e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Creating volume 7f777dac-2380-4cee-9588-8206bf6df504 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:36:05 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:36:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:05 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 1073741824 Jul 22 20:36:05 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:06 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 1073741824" returned: 0 in 0.497s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:06 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 Jul 22 20:36:06 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:06 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d70739-d449-4af5-a7b3-2f6e726d47e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f777dac-2380-4cee-9588-8206bf6df504', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6addd47f-2127-48de-b80f-3145c5ddd3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:06 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Volume volume-7f777dac-2380-4cee-9588-8206bf6df504 (7f777dac-2380-4cee-9588-8206bf6df504): created successfully Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6addd47f-2127-48de-b80f-3145c5ddd3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Flow 'volume_create_manager' (e6ec8a1b-d0b1-444c-9309-0e1cc48604fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:36:06 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-806b903a-b04d-4500-bb7e-c8c7055f707f tempest-ServersNegativeTestJSON-1269268184 None] Created volume successfully. Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Flow 'volume_create_manager' (86b6ffb9-c42f-4991-9464-7dce07040057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b80449-e864-49a8-88b9-fdb0530bd527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b80449-e864-49a8-88b9-fdb0530bd527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-890656800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c66581-2ca2-4525-878b-18883a03856a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca7970f7d94602abb39d542c105cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:36:11Z,use_quota=True,user_id='a0ce7e5587fc4e2a89c721c5cea0287e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15793027-a19b-4b8a-9d5f-68442c7d9f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15793027-a19b-4b8a-9d5f-68442c7d9f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2878b1d-1af7-442a-b4d0-4bfe872d529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2878b1d-1af7-442a-b4d0-4bfe872d529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c66581-2ca2-4525-878b-18883a03856a', 'volume_name': 'volume-16c66581-2ca2-4525-878b-18883a03856a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e902ecd5-329b-4a74-b832-03884123330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e902ecd5-329b-4a74-b832-03884123330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308dc526-3516-43ed-a173-8adc7242276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Volume 16c66581-2ca2-4525-878b-18883a03856a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c66581-2ca2-4525-878b-18883a03856a', 'volume_size': 1} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-890656800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c66581-2ca2-4525-878b-18883a03856a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca7970f7d94602abb39d542c105cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:36:11Z,use_quota=True,user_id='a0ce7e5587fc4e2a89c721c5cea0287e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Creating volume 16c66581-2ca2-4525-878b-18883a03856a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:36:11 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:11 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a 1073741824 Jul 22 20:36:11 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:11 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a 1073741824" returned: 0 in 0.591s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:11 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a Jul 22 20:36:11 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:11 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a" returned: 0 in 0.292s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308dc526-3516-43ed-a173-8adc7242276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c66581-2ca2-4525-878b-18883a03856a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7447c95d-92e6-4eb4-a49e-08e8b30bc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Volume volume-16c66581-2ca2-4525-878b-18883a03856a (16c66581-2ca2-4525-878b-18883a03856a): created successfully Jul 22 20:36:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7447c95d-92e6-4eb4-a49e-08e8b30bc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Flow 'volume_create_manager' (86b6ffb9-c42f-4991-9464-7dce07040057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:36:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e0abd23b-b099-473b-856c-79a05a5d6f43 tempest-ServersNegativeTestJSON-1269268184 None] Created volume successfully. Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "cinder-16c66581-2ca2-4525-878b-18883a03856a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-16c66581-2ca2-4525-878b-18883a03856a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "cinder-quobyte-16c66581-2ca2-4525-878b-18883a03856a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-quobyte-16c66581-2ca2-4525-878b-18883a03856a" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f2a55c-b9dc-40e2-933a-f238ca1c43d4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:14 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a Jul 22 20:36:14 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:14 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a" returned: 0 in 0.428s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:14 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a Jul 22 20:36:14 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:14 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-16c66581-2ca2-4525-878b-18883a03856a" returned: 0 in 0.291s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-quobyte-16c66581-2ca2-4525-878b-18883a03856a" released by "delete_volume" :: held 0.779s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Created reservations ['8684444b-8331-4023-bb48-57f773223aa8', '62ae87d5-8834-4368-9ab3-177c23f893cf', 'f03e3f56-88e2-4755-843d-68145e438dd8', '78a49d43-712b-41ef-89d1-3e2801a7d190'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:15 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:36:15 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "cinder-7f777dac-2380-4cee-9588-8206bf6df504-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-7f777dac-2380-4cee-9588-8206bf6df504-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "cinder-quobyte-7f777dac-2380-4cee-9588-8206bf6df504" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-quobyte-7f777dac-2380-4cee-9588-8206bf6df504" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e92bf9b-4313-4e3c-8304-f4621979f51f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:15 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.477s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:36:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Deleted volume successfully. Jul 22 20:36:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-73cd4af5-79d6-43b7-82ad-38637b78f5ec tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-16c66581-2ca2-4525-878b-18883a03856a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:15 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 Jul 22 20:36:15 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:16 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504" returned: 0 in 0.554s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:16 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504 Jul 22 20:36:16 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:16 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7f777dac-2380-4cee-9588-8206bf6df504" returned: 0 in 0.350s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-quobyte-7f777dac-2380-4cee-9588-8206bf6df504" released by "delete_volume" :: held 0.952s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Created reservations ['52a10b49-a335-436d-ab1d-03d3d8b54770', 'b265aa5a-e4f1-4c70-89e3-0609a6618b63', 'ce05ef66-b5d4-474a-b8b3-7a67564d13de', 'e0f73344-25b8-44d5-8c81-b0598ed86b48'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:16 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:36:16 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:17 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.457s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:17 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:36:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Deleted volume successfully. Jul 22 20:36:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b97d57ab-cf07-4210-84f0-b4009d87b1fb tempest-ServersNegativeTestJSON-1269268184 None] Lock "cinder-7f777dac-2380-4cee-9588-8206bf6df504-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:26 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=50,cinder:SELECT=38,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:36:26 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=34,cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Flow 'volume_create_manager' (a1f54eb4-0f71-43a0-9b8d-00f503b3c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40779844-cc7b-4d4d-93f0-a5283af444ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40779844-cc7b-4d4d-93f0-a5283af444ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-647501568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659ef091-a172-4e20-8b77-0eefdb6aeca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129af62495a74e3abd035a0ceffd5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:36:39Z,use_quota=True,user_id='c572b74b10cd45a99cad848bb67f81b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91861e66-1260-4bd1-84a9-6436c806e135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91861e66-1260-4bd1-84a9-6436c806e135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3538c558-2922-4e21-9147-1f8e5de284cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3538c558-2922-4e21-9147-1f8e5de284cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659ef091-a172-4e20-8b77-0eefdb6aeca7', 'volume_name': 'volume-659ef091-a172-4e20-8b77-0eefdb6aeca7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f0897d-c7c5-4ef0-96fe-499174276e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f0897d-c7c5-4ef0-96fe-499174276e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ebf208-f7ad-45d6-a620-294df9f44b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:38 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Volume 659ef091-a172-4e20-8b77-0eefdb6aeca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659ef091-a172-4e20-8b77-0eefdb6aeca7', 'volume_size': 1} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-647501568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659ef091-a172-4e20-8b77-0eefdb6aeca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129af62495a74e3abd035a0ceffd5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:36:39Z,use_quota=True,user_id='c572b74b10cd45a99cad848bb67f81b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Creating volume 659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:36:38 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:36:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:38 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 1073741824 Jul 22 20:36:38 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:39 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 1073741824" returned: 0 in 0.610s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:39 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 Jul 22 20:36:39 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:39 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ebf208-f7ad-45d6-a620-294df9f44b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659ef091-a172-4e20-8b77-0eefdb6aeca7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cca893-5766-42d3-b2e3-13c3464cacb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:36:39 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Volume volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 (659ef091-a172-4e20-8b77-0eefdb6aeca7): created successfully Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cca893-5766-42d3-b2e3-13c3464cacb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:36:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Flow 'volume_create_manager' (a1f54eb4-0f71-43a0-9b8d-00f503b3c844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:36:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-93bf0d64-f1cd-439e-83e1-2f102ae70d9a req-523cbf08-de89-4041-9fb8-483383a376b0 tempest-VolumesSnapshotsTestJSON-807190114 None] Created volume successfully. Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:41 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:36:41 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:41 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.282s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:36:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Creating offline snapshot 2257311b-0e30-4b80-b909-a9d8726045e8 of volume 659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:36:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60616a5-c543-42b0-96bc-12494549b67f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:36:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:44 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 Jul 22 20:36:44 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:44 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7" returned: 0 in 0.986s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:44 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 1G Jul 22 20:36:44 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:46 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 1G" returned: 0 in 1.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:46 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 Jul 22 20:36:46 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:46 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8" returned: 0 in 0.808s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:46 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 is being set with open permissions: ugo+rw Jul 22 20:36:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:46 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 Jul 22 20:36:46 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:47 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8" returned: 0 in 0.922s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:47 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.info Jul 22 20:36:47 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:48 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.info" returned: 0 in 0.662s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:48 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.info is being set with open permissions: ugo+rw Jul 22 20:36:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:48 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.info Jul 22 20:36:48 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:48 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.info" returned: 0 in 0.429s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.331s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-c2c5b2f4-d9d9-4445-9d72-3fd57437ae8e req-24960a09-62a6-4089-bd98-93ea30309dc7 tempest-VolumesSnapshotsTestJSON-807190114 None] Create snapshot completed successfully Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "cinder-2257311b-0e30-4b80-b909-a9d8726045e8-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-2257311b-0e30-4b80-b909-a9d8726045e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "cinder-quobyte-659ef091-a172-4e20-8b77-0eefdb6aeca7" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-quobyte-659ef091-a172-4e20-8b77-0eefdb6aeca7" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "cinder-quobyte-2257311b-0e30-4b80-b909-a9d8726045e8" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-quobyte-2257311b-0e30-4b80-b909-a9d8726045e8" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Deleting offline snapshot 2257311b-0e30-4b80-b909-a9d8726045e8 of volume 659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] snapshot_file for this snap is: volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32df682-b06d-40e2-9666-81497b068486]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:50 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 Jul 22 20:36:50 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:50 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8" returned: 0 in 0.658s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-659ef091-a172-4e20-8b77-0eefdb6aeca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:36:51 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6aeb0-67ab-45ae-8e75-7c64c7cb4b78]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:36:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:51 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 Jul 22 20:36:51 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:51 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7" returned: 0 in 0.615s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:51 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 Jul 22 20:36:51 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:52 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8" returned: 0 in 0.766s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:52 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8 Jul 22 20:36:52 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:52 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7.2257311b-0e30-4b80-b909-a9d8726045e8" returned: 0 in 0.511s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-quobyte-2257311b-0e30-4b80-b909-a9d8726045e8" released by "_delete_snapshot" :: held 2.806s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-quobyte-659ef091-a172-4e20-8b77-0eefdb6aeca7" released by "delete_snapshot" :: held 2.857s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:53 devstack cinder-volume[87818]: WARNING cinder.quota [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:36:53 devstack cinder-volume[87818]: DEBUG cinder.quota [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Created reservations ['0e35dc26-3257-461d-a602-61c6fc973ca9', '422e8fd9-2fe0-4586-925a-fe8dd59fc3ca', 'd470692f-27c2-4031-a39f-9c8e473fd930', '549ecd6c-6014-4c9c-9649-5d9abb0eed23'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:36:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Delete snapshot completed successfully. Jul 22 20:36:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-c4d7ea66-b8a6-405d-bec5-3d053caa19a2 req-82712afc-3265-446c-ba85-9cb7eb623e9b tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-2257311b-0e30-4b80-b909-a9d8726045e8-delete_snapshot" released by "delete_snapshot" :: held 3.240s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "cinder-659ef091-a172-4e20-8b77-0eefdb6aeca7-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-659ef091-a172-4e20-8b77-0eefdb6aeca7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "cinder-quobyte-659ef091-a172-4e20-8b77-0eefdb6aeca7" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:36:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-quobyte-659ef091-a172-4e20-8b77-0eefdb6aeca7" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:36:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f3c339-8739-41fb-b37c-e11a2b5b963e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:36:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:55 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 Jul 22 20:36:55 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:55 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7" returned: 0 in 0.989s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:55 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7 Jul 22 20:36:55 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:56 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-659ef091-a172-4e20-8b77-0eefdb6aeca7" returned: 0 in 0.687s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-quobyte-659ef091-a172-4e20-8b77-0eefdb6aeca7" released by "delete_volume" :: held 1.791s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG cinder.quota [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Created reservations ['4385ce98-71e0-4eee-bab5-db2ea03437b6', '195cbf60-f646-4f57-83de-c439cd61250d', '77db2255-b6ab-463e-b88f-f7fd56e1589b', 'ac83e5b5-ccd2-4872-a403-10e61bc17056'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:36:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:36:56 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:36:56 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:36:57 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Jul 22 20:36:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.643s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:36:57 devstack cinder-volume[87818]: DEBUG cinder.manager [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:36:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Deleted volume successfully. Jul 22 20:36:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-0afbc882-a69a-4050-a58d-d24faf453b58 req-bc6c729b-affe-4a8e-b444-f5378b1316fa tempest-VolumesSnapshotsTestJSON-807190114 None] Lock "cinder-659ef091-a172-4e20-8b77-0eefdb6aeca7-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Flow 'volume_create_manager' (767e1fed-d94a-4ab9-b9e2-c8a3236688f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c5fd61-c150-42b7-a731-ceb28486e8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c5fd61-c150-42b7-a731-ceb28486e8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1623526684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92179663-ca8d-4df4-af00-dd03dc40e832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7103d7c0a0c4c4784960025416f56a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:03Z,use_quota=True,user_id='c8fc903d85384d82b748ed6c84750f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50441a7-1c7b-492f-b27e-f8cc0b8d396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50441a7-1c7b-492f-b27e-f8cc0b8d396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bd76d-5f5f-44d4-8c00-35b232aa5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bd76d-5f5f-44d4-8c00-35b232aa5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92179663-ca8d-4df4-af00-dd03dc40e832', 'volume_name': 'volume-92179663-ca8d-4df4-af00-dd03dc40e832', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7bcc2a-96be-481a-b79b-8a3579e36b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7bcc2a-96be-481a-b79b-8a3579e36b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d5b7c0-a8b9-4585-b9c9-6dd8307b103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:03 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Volume 92179663-ca8d-4df4-af00-dd03dc40e832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92179663-ca8d-4df4-af00-dd03dc40e832', 'volume_size': 1} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1623526684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92179663-ca8d-4df4-af00-dd03dc40e832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7103d7c0a0c4c4784960025416f56a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:03Z,use_quota=True,user_id='c8fc903d85384d82b748ed6c84750f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Creating volume 92179663-ca8d-4df4-af00-dd03dc40e832 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:37:03 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:37:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:03 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 1073741824 Jul 22 20:37:03 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:04 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 1073741824" returned: 0 in 1.004s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:05 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 Jul 22 20:37:05 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:05 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832" returned: 0 in 0.685s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:37:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d5b7c0-a8b9-4585-b9c9-6dd8307b103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92179663-ca8d-4df4-af00-dd03dc40e832', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6b59b0-8353-4d74-ba1b-49f9df40535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Volume volume-92179663-ca8d-4df4-af00-dd03dc40e832 (92179663-ca8d-4df4-af00-dd03dc40e832): created successfully Jul 22 20:37:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6b59b0-8353-4d74-ba1b-49f9df40535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Flow 'volume_create_manager' (767e1fed-d94a-4ab9-b9e2-c8a3236688f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-64e7b709-7d7f-440f-92d9-93754799223b tempest-ServerRescueNegativeTestJSON-805690169 None] Created volume successfully. Jul 22 20:37:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d451c8da-c08c-4e0b-af48-ad8f89d80df3 tempest-GroupSnapshotsTest-1142983477 None] Group tempest-GroupSnapshotsTest-Group-1649929978: creating Jul 22 20:37:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d451c8da-c08c-4e0b-af48-ad8f89d80df3 tempest-GroupSnapshotsTest-1142983477 None] Group tempest-GroupSnapshotsTest-Group-1649929978: created successfully Jul 22 20:37:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d451c8da-c08c-4e0b-af48-ad8f89d80df3 tempest-GroupSnapshotsTest-1142983477 None] Create group completed successfully. Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (fb62fd2b-802a-4ac7-9fbe-a1c41dc44c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c01aad3-fe0a-4278-9370-773c1bb9597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c01aad3-fe0a-4278-9370-773c1bb9597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615811373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e814bdaf-ac4d-49fd-a548-f858291a89df,host='devstack@QuobyteHD#QuobyteHD',id=2cded11d-9c5e-48f5-b07a-73f5e86796c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:09Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea2b4463-fbbe-4575-afe8-08a20809122b),volume_type_id=ea2b4463-fbbe-4575-afe8-08a20809122b)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f42e92-13a5-49cf-a926-796c84e7e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f42e92-13a5-49cf-a926-796c84e7e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03129433-bc50-447c-9ddc-0c695f647c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03129433-bc50-447c-9ddc-0c695f647c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cded11d-9c5e-48f5-b07a-73f5e86796c3', 'volume_name': 'volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3619705c-7e59-436f-a1b0-14eeab862af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3619705c-7e59-436f-a1b0-14eeab862af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c14ecf7-a5ae-4f7c-a430-824d3c36cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:09 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Volume 2cded11d-9c5e-48f5-b07a-73f5e86796c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3', 'volume_size': 1} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e814bdaf-ac4d-49fd-a548-f858291a89df,created_at=2026-07-22T18:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615811373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e814bdaf-ac4d-49fd-a548-f858291a89df,host='devstack@QuobyteHD#QuobyteHD',id=2cded11d-9c5e-48f5-b07a-73f5e86796c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:09Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea2b4463-fbbe-4575-afe8-08a20809122b),volume_type_id=ea2b4463-fbbe-4575-afe8-08a20809122b)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Creating volume 2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:37:09 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:37:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:09 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 1073741824 Jul 22 20:37:09 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:10 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 1073741824" returned: 0 in 0.891s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:10 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 Jul 22 20:37:10 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:10 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3" returned: 0 in 0.667s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:37:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c14ecf7-a5ae-4f7c-a430-824d3c36cb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cfab04-3e03-45cd-9645-7ef668e5f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Volume volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 (2cded11d-9c5e-48f5-b07a-73f5e86796c3): created successfully Jul 22 20:37:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cfab04-3e03-45cd-9645-7ef668e5f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (fb62fd2b-802a-4ac7-9fbe-a1c41dc44c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-94bce979-58f5-424f-9d74-e837a283fee0 tempest-GroupSnapshotsTest-1142983477 None] Created volume successfully. Jul 22 20:37:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] GroupSnapshot 69e9fe79-3057-4349-8b36-d501590a203a: creating. Jul 22 20:37:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Group snapshot 69e9fe79-3057-4349-8b36-d501590a203a: creating. {{(pid=87818) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 20:37:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Creating offline snapshot fe04f164-f5a6-4e8c-ba6e-09770e271829 of volume 2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:37:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f187609c-e89c-43e7-9b8c-e94861408e87]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:12 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 Jul 22 20:37:12 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:13 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3" returned: 0 in 0.514s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:13 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 1G Jul 22 20:37:13 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:13 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 1G" returned: 0 in 0.611s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:13 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 Jul 22 20:37:13 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:14 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829" returned: 0 in 0.365s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:14 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:14 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 Jul 22 20:37:14 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:14 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829" returned: 0 in 0.255s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:14 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.info Jul 22 20:37:14 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Flow 'volume_create_manager' (d62d7239-070c-4e10-988b-1e5deac9e075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a108f6e6-b981-4c0b-88ce-0c4dca40fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a108f6e6-b981-4c0b-88ce-0c4dca40fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-467505374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698e0a00-9dc5-4c07-b89d-384d9f6ac4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d118048c744fc5af01e1e915afe63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:15Z,use_quota=True,user_id='cf2086cf43cc48be8f49d0baa6ac601d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7990f0ae-f3e4-4d33-a365-93607a2532f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7990f0ae-f3e4-4d33-a365-93607a2532f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af4cc29-e512-4ba7-9f1f-779391c63323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af4cc29-e512-4ba7-9f1f-779391c63323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '698e0a00-9dc5-4c07-b89d-384d9f6ac4c2', 'volume_name': 'volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a456a6c-a6eb-400d-a136-d046d215e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a456a6c-a6eb-400d-a136-d046d215e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7761048c-1f37-4304-9844-09983fa50b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Volume 698e0a00-9dc5-4c07-b89d-384d9f6ac4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2', 'volume_size': 1} Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:14 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.info" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:14 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:37:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:14 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.info Jul 22 20:37:14 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:15 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.info" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-467505374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698e0a00-9dc5-4c07-b89d-384d9f6ac4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d118048c744fc5af01e1e915afe63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:15Z,use_quota=True,user_id='cf2086cf43cc48be8f49d0baa6ac601d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Creating volume 698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:37:15 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:15 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 1073741824 Jul 22 20:37:15 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-58831719-bd76-4664-8a8b-0f6db1abbdee tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 69e9fe79-3057-4349-8b36-d501590a203a: created successfully Jul 22 20:37:15 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 1073741824" returned: 0 in 0.615s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:15 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 Jul 22 20:37:15 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:16 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2" returned: 0 in 0.287s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7761048c-1f37-4304-9844-09983fa50b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f86027-0090-47b3-958d-551784a6e2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:16 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Volume volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 (698e0a00-9dc5-4c07-b89d-384d9f6ac4c2): created successfully Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f86027-0090-47b3-958d-551784a6e2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Flow 'volume_create_manager' (d62d7239-070c-4e10-988b-1e5deac9e075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4f767a2a-36dd-4b92-b71e-f2737013a21d tempest-TaggedAttachmentsTest-1218120544 None] Created volume successfully. Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-fe04f164-f5a6-4e8c-ba6e-09770e271829-f2a60372-8692-4d3e-b128-c4e61a9278b8" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-fe04f164-f5a6-4e8c-ba6e-09770e271829-f2a60372-8692-4d3e-b128-c4e61a9278b8" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Creating volume f2a60372-8692-4d3e-b128-c4e61a9278b8 from snapshot fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-f2a60372-8692-4d3e-b128-c4e61a9278b8" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-f2a60372-8692-4d3e-b128-c4e61a9278b8" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] snapshot: fe04f164-f5a6-4e8c-ba6e-09770e271829, volume: f2a60372-8692-4d3e-b128-c4e61a9278b8, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b78341-f08f-4c3a-a5a2-7d14d6ee5da3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:17 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 Jul 22 20:37:17 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:17 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829" returned: 0 in 0.545s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5d88a-6765-48df-8dcc-11bb7f4a1eef]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:17 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 Jul 22 20:37:17 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:18 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3" returned: 0 in 0.658s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:18 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:37:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:18 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 Jul 22 20:37:18 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Acquiring lock "cinder-92179663-ca8d-4df4-af00-dd03dc40e832-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "cinder-92179663-ca8d-4df4-af00-dd03dc40e832-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Acquiring lock "cinder-quobyte-92179663-ca8d-4df4-af00-dd03dc40e832" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "cinder-quobyte-92179663-ca8d-4df4-af00-dd03dc40e832" acquired by "delete_volume" :: waited 0.045s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[942d6a28-8259-4722-b2de-770e1c362eab]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:19 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 Jul 22 20:37:19 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:20 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832" returned: 0 in 1.497s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:20 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832 Jul 22 20:37:20 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:22 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-92179663-ca8d-4df4-af00-dd03dc40e832" returned: 0 in 1.361s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "cinder-quobyte-92179663-ca8d-4df4-af00-dd03dc40e832" released by "delete_volume" :: held 2.956s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Created reservations ['028955aa-307e-41ce-be55-156e8278bb09', '6556b954-83d9-4a68-bee3-af3172d4de21', '4cd118af-6532-47f8-b456-8fcc12bb939a', 'd91dc23b-4151-44f8-8d00-0debac7c0ff9'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:22 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:37:22 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:23 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 1.206s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:23 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:37:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Deleted volume successfully. Jul 22 20:37:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-fc6a6a85-9db1-4816-9bd8-ae3c3c4a3521 tempest-ServerRescueNegativeTestJSON-805690169 None] Lock "cinder-92179663-ca8d-4df4-af00-dd03dc40e832-delete_volume" released by "delete_volume" :: held 4.885s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:27 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8" returned: 0 in 9.484s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:27 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cdab39-7ea2-4f5f-969d-fc98c90d80f6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:27 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 Jul 22 20:37:27 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:28 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3" returned: 0 in 0.917s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:28 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3, size 1024.00 MB, duration 9.49 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:37:28 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Converted 1024.00 MB image at 107.96 MB/s Jul 22 20:37:28 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:37:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:28 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 Jul 22 20:37:28 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:29 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8" returned: 0 in 0.336s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-f2a60372-8692-4d3e-b128-c4e61a9278b8" released by "_copy_volume_from_snapshot" :: held 12.185s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-fe04f164-f5a6-4e8c-ba6e-09770e271829-f2a60372-8692-4d3e-b128-c4e61a9278b8" released by "_create_volume_from_snapshot" :: held 12.258s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.286s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:29 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c026cc07-977c-41ce-8e89-c8a93e394259 tempest-GroupSnapshotsTest-1142983477 None] Create group from source-snapshot-69e9fe79-3057-4349-8b36-d501590a203a completed successfully. Jul 22 20:37:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-f2a60372-8692-4d3e-b128-c4e61a9278b8" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-f2a60372-8692-4d3e-b128-c4e61a9278b8" acquired by "delete_volume" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:30 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e7ba1f-21c8-4122-988a-ff4f94de790f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:31 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 Jul 22 20:37:31 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:31 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8" returned: 0 in 0.476s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:31 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8 Jul 22 20:37:31 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:31 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a60372-8692-4d3e-b128-c4e61a9278b8" returned: 0 in 0.399s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-f2a60372-8692-4d3e-b128-c4e61a9278b8" released by "delete_volume" :: held 0.943s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:31 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['89a895ec-94d4-4cbc-9929-0495a0fc16a0'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:37:31 devstack cinder-volume[87818]: WARNING cinder.quota [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1869169880 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1869169880, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:37:31 devstack cinder-volume[87818]: WARNING cinder.quota [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1869169880 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1869169880, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:37:31 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['a967771d-f8e9-4eaa-95a1-48f1ae417221', '7c49b2aa-f951-46b8-acc0-0c4e758b9351', 'acf538e0-bf05-4ce2-a131-2f01a6cded9d', '07fe9503-4d66-4873-80e1-21943fc91e89'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:32 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:37:32 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 69e9fe79-3057-4349-8b36-d501590a203a: deleting Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 69e9fe79-3057-4349-8b36-d501590a203a: deleting {{(pid=87818) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-2cded11d-9c5e-48f5-b07a-73f5e86796c3" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-2cded11d-9c5e-48f5-b07a-73f5e86796c3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-fe04f164-f5a6-4e8c-ba6e-09770e271829" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-fe04f164-f5a6-4e8c-ba6e-09770e271829" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Deleting offline snapshot fe04f164-f5a6-4e8c-ba6e-09770e271829 of volume 2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:37:32 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] snapshot_file for this snap is: volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.310s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:37:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cbd16627-602c-4af7-8cae-7460f0e5db32 tempest-GroupSnapshotsTest-1142983477 None] Delete group completed successfully. Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bc1d4c-c12d-45e7-a248-eb68d6527c06]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:32 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 Jul 22 20:37:32 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:32 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b423f-c68f-4d37-9091-7036dda4a4eb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:32 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 Jul 22 20:37:32 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:33 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3" returned: 0 in 0.467s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:33 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 Jul 22 20:37:33 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:33 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829" returned: 0 in 0.646s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:33 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829 Jul 22 20:37:33 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:34 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3.fe04f164-f5a6-4e8c-ba6e-09770e271829" returned: 0 in 0.511s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-fe04f164-f5a6-4e8c-ba6e-09770e271829" released by "_delete_snapshot" :: held 2.186s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-2cded11d-9c5e-48f5-b07a-73f5e86796c3" released by "delete_snapshot" :: held 2.219s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:34 devstack cinder-volume[87818]: WARNING cinder.quota [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1869169880 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1869169880, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:37:34 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['1c203e77-ca5c-48d2-95eb-4bd619d6ad80', 'dd3afae7-5208-4672-b88d-450ca5300a53', 'a52a8ec5-4f92-41d4-97ef-83e0fedd96f2', '944ae483-103a-4230-80b5-9e103a849ebb'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:37:34 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1a16412a-7016-4f6e-8f21-ae9e3d391862 tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 69e9fe79-3057-4349-8b36-d501590a203a: deleted successfully Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Flow 'volume_create_manager' (28941208-1136-418a-a151-6eaceb9de03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3278b0c3-49ff-4c09-91de-1ba3c2127582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3278b0c3-49ff-4c09-91de-1ba3c2127582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-963615116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970bdf03-fb86-484e-97cb-e81ba6369629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9fd7bad19246d79fb444bcb4a06307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:36Z,use_quota=True,user_id='5c9425d256f246b38fa0e8a897860274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c87776-ad4a-44ab-a0a2-f52fb80a5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c87776-ad4a-44ab-a0a2-f52fb80a5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ddb88a-2d7d-45f2-a7bb-a35f35ae1bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ddb88a-2d7d-45f2-a7bb-a35f35ae1bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970bdf03-fb86-484e-97cb-e81ba6369629', 'volume_name': 'volume-970bdf03-fb86-484e-97cb-e81ba6369629', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5047f7df-b3a5-4bb2-a65a-eebe88829070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5047f7df-b3a5-4bb2-a65a-eebe88829070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4fe340-36f0-40a1-bac7-dbfd16cef32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:36 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Volume 970bdf03-fb86-484e-97cb-e81ba6369629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970bdf03-fb86-484e-97cb-e81ba6369629', 'volume_size': 1} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-963615116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970bdf03-fb86-484e-97cb-e81ba6369629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9fd7bad19246d79fb444bcb4a06307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:36Z,use_quota=True,user_id='5c9425d256f246b38fa0e8a897860274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Creating volume 970bdf03-fb86-484e-97cb-e81ba6369629 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:37:36 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=53,cinder:UPDATE=60,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=59,cinder:UPDATE=55,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-2cded11d-9c5e-48f5-b07a-73f5e86796c3" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:37:36 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 1073741824 Jul 22 20:37:36 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-2cded11d-9c5e-48f5-b07a-73f5e86796c3" acquired by "delete_volume" :: waited 0.043s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8f5456-43a0-4776-8a1d-4089ef2d02fb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:36 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 Jul 22 20:37:36 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:37 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3" returned: 0 in 0.628s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:37 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 1073741824" returned: 0 in 0.875s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:37 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3 Jul 22 20:37:37 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:37 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 Jul 22 20:37:37 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:37 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629" returned: 0 in 0.340s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4fe340-36f0-40a1-bac7-dbfd16cef32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970bdf03-fb86-484e-97cb-e81ba6369629', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055b81f5-21a8-4177-b1e7-df5d178f051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:37 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Volume volume-970bdf03-fb86-484e-97cb-e81ba6369629 (970bdf03-fb86-484e-97cb-e81ba6369629): created successfully Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055b81f5-21a8-4177-b1e7-df5d178f051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Flow 'volume_create_manager' (28941208-1136-418a-a151-6eaceb9de03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f65b92d9-dce4-4296-886b-23d8747fa2af tempest-ServerActionsTestOtherA-425644103 None] Created volume successfully. Jul 22 20:37:37 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cded11d-9c5e-48f5-b07a-73f5e86796c3" returned: 0 in 0.608s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-2cded11d-9c5e-48f5-b07a-73f5e86796c3" released by "delete_volume" :: held 1.370s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:37:37 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['59ebc302-da60-454b-9766-4bda432f115a'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:37:38 devstack cinder-volume[87818]: WARNING cinder.db.api [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1869169880'] Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['a144c5bd-751a-402d-9d1c-be7568747767', 'f227b558-6a74-410f-9b3d-439860380021', 'f3d0dc54-2862-420e-ad89-dc322958b244', 'd834ec43-53da-446b-8efc-c4936fd33ad8'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:38 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:37:38 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:38 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.364s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:38 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:37:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f48c9874-2f36-4fcf-ab9e-89c474030882 tempest-GroupSnapshotsTest-1142983477 None] Delete group completed successfully. Jul 22 20:37:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0109d96c-113c-4931-835a-6718cc3da065 tempest-GroupSnapshotsTest-1142983477 None] Group tempest-GroupSnapshotsTest-Group-346948459: creating Jul 22 20:37:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0109d96c-113c-4931-835a-6718cc3da065 tempest-GroupSnapshotsTest-1142983477 None] Group tempest-GroupSnapshotsTest-Group-346948459: created successfully Jul 22 20:37:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0109d96c-113c-4931-835a-6718cc3da065 tempest-GroupSnapshotsTest-1142983477 None] Create group completed successfully. Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:41 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:37:41 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:41 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.335s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 8 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (0a0da55e-7001-4ecd-aa2e-28604cd1c491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d659e8-e070-48df-850d-aa1713d10ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d659e8-e070-48df-850d-aa1713d10ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919157978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5847a3c9-e97d-45ba-84a2-23f610a854e6,host='devstack@QuobyteHD#QuobyteHD',id=6110f494-288d-42a1-85d3-64c3a9dfc79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:42Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f06c1020-2093-4447-88a2-7c627bba73cc),volume_type_id=f06c1020-2093-4447-88a2-7c627bba73cc)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd01c74-ad6b-489e-8047-d1079dd9afca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd01c74-ad6b-489e-8047-d1079dd9afca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b8a931-d9bd-425e-b654-e13451e2f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b8a931-d9bd-425e-b654-e13451e2f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6110f494-288d-42a1-85d3-64c3a9dfc79a', 'volume_name': 'volume-6110f494-288d-42a1-85d3-64c3a9dfc79a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af513951-2ea0-468b-9a7b-17d804625415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af513951-2ea0-468b-9a7b-17d804625415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5247d05-0a87-47b8-af5d-18d793043b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Volume 6110f494-288d-42a1-85d3-64c3a9dfc79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6110f494-288d-42a1-85d3-64c3a9dfc79a', 'volume_size': 1} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5847a3c9-e97d-45ba-84a2-23f610a854e6,created_at=2026-07-22T18:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919157978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5847a3c9-e97d-45ba-84a2-23f610a854e6,host='devstack@QuobyteHD#QuobyteHD',id=6110f494-288d-42a1-85d3-64c3a9dfc79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:42Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f06c1020-2093-4447-88a2-7c627bba73cc),volume_type_id=f06c1020-2093-4447-88a2-7c627bba73cc)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Creating volume 6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:37:42 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:42 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a 1073741824 Jul 22 20:37:42 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:42 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a 1073741824" returned: 0 in 0.734s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:42 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a Jul 22 20:37:42 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:43 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a" returned: 0 in 0.413s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:37:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5247d05-0a87-47b8-af5d-18d793043b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6110f494-288d-42a1-85d3-64c3a9dfc79a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd5e6cd-476f-48bd-a940-01a38383c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:43 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Volume volume-6110f494-288d-42a1-85d3-64c3a9dfc79a (6110f494-288d-42a1-85d3-64c3a9dfc79a): created successfully Jul 22 20:37:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd5e6cd-476f-48bd-a940-01a38383c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (0a0da55e-7001-4ecd-aa2e-28604cd1c491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:43 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c47f2407-3fbb-4926-9a3a-0729eb7d0aff tempest-GroupSnapshotsTest-1142983477 None] Created volume successfully. Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (e99a24da-9798-49ad-b312-5d070e61f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3554d13f-a7a6-4801-b4d3-8ff1e58b1ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3554d13f-a7a6-4801-b4d3-8ff1e58b1ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762363572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5847a3c9-e97d-45ba-84a2-23f610a854e6,host='devstack@QuobyteHD#QuobyteHD',id=ec7a85de-99bb-4110-b31b-4e52f66f3d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:46Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f06c1020-2093-4447-88a2-7c627bba73cc),volume_type_id=f06c1020-2093-4447-88a2-7c627bba73cc)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671f1846-23dc-424c-8863-91de7be5172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671f1846-23dc-424c-8863-91de7be5172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d822cf6-b347-4e5c-87bb-67254a5b762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d822cf6-b347-4e5c-87bb-67254a5b762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7a85de-99bb-4110-b31b-4e52f66f3d85', 'volume_name': 'volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147ed7f5-59bd-46c7-89de-11903ba6719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147ed7f5-59bd-46c7-89de-11903ba6719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8831f009-362f-44a8-8d33-54944ffea771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:45 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Volume ec7a85de-99bb-4110-b31b-4e52f66f3d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85', 'volume_size': 1} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5847a3c9-e97d-45ba-84a2-23f610a854e6,created_at=2026-07-22T18:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762363572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5847a3c9-e97d-45ba-84a2-23f610a854e6,host='devstack@QuobyteHD#QuobyteHD',id=ec7a85de-99bb-4110-b31b-4e52f66f3d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:37:46Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f06c1020-2093-4447-88a2-7c627bba73cc),volume_type_id=f06c1020-2093-4447-88a2-7c627bba73cc)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Creating volume ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:37:45 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:37:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:45 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 1073741824 Jul 22 20:37:45 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:46 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 1073741824" returned: 0 in 0.782s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:46 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 Jul 22 20:37:46 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:47 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85" returned: 0 in 0.345s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:37:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8831f009-362f-44a8-8d33-54944ffea771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a909fe-ae8a-4746-9f39-ebfc3904f5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:37:47 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Volume volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 (ec7a85de-99bb-4110-b31b-4e52f66f3d85): created successfully Jul 22 20:37:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a909fe-ae8a-4746-9f39-ebfc3904f5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:37:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (e99a24da-9798-49ad-b312-5d070e61f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:37:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-53543b17-6b74-49d8-aa6f-4a70b5901acf tempest-GroupSnapshotsTest-1142983477 None] Created volume successfully. Jul 22 20:37:48 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6696f79e-4332-4c16-a93a-603cf3c6cdaf tempest-GroupSnapshotsTest-1142983477 None] Update group completed successfully. Jul 22 20:37:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3c985a40-9023-4a5b-8c0a-e09849535b10 tempest-GroupSnapshotsTest-1142983477 None] Update group completed successfully. Jul 22 20:37:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6ff20ba8-102a-421f-8af5-d7aea485de33 tempest-GroupSnapshotsTest-1142983477 None] Update group completed successfully. Jul 22 20:37:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1ef95c7d-d0a4-4410-846f-7b234c6ac300 tempest-GroupSnapshotsTest-1142983477 None] Update group completed successfully. Jul 22 20:37:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] GroupSnapshot 11dcb11c-0f68-4900-bc6f-bb6da749b3ea: creating. Jul 22 20:37:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Group snapshot 11dcb11c-0f68-4900-bc6f-bb6da749b3ea: creating. {{(pid=87818) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 20:37:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Creating offline snapshot 5969bb9c-e788-4106-a6f2-c79f1b8decd1 of volume 6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:37:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6463765-5542-41c4-88bd-64f0315a95ba]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:54 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a Jul 22 20:37:54 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:54 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a" returned: 0 in 0.521s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:54 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 1G Jul 22 20:37:54 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:55 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 1G" returned: 0 in 0.833s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6110f494-288d-42a1-85d3-64c3a9dfc79a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:55 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6110f494-288d-42a1-85d3-64c3a9dfc79a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 Jul 22 20:37:55 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:56 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6110f494-288d-42a1-85d3-64c3a9dfc79a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1" returned: 0 in 0.642s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:56 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:37:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:56 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 Jul 22 20:37:56 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:56 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1" returned: 0 in 0.473s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:56 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.info Jul 22 20:37:56 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:56 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.info" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:56 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:57 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.info Jul 22 20:37:57 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:57 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.info" returned: 0 in 0.421s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.526s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Creating offline snapshot e2d21b34-e7c9-443d-a78e-146c45ef9562 of volume ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bded2d27-7ae8-4a82-923f-01253b5a48a7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:37:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:57 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 Jul 22 20:37:57 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:58 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85" returned: 0 in 0.561s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:58 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 1G Jul 22 20:37:58 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:58 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 1G" returned: 0 in 0.583s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:58 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 Jul 22 20:37:58 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:59 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562" returned: 0 in 0.341s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:59 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:59 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 Jul 22 20:37:59 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:59 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562" returned: 0 in 0.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:59 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.info Jul 22 20:37:59 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:59 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.info" returned: 0 in 0.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:59 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:37:59 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.info Jul 22 20:37:59 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:37:59 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.info" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:37:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2ea73822-4704-4615-97f1-de6d27585056 tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 11dcb11c-0f68-4900-bc6f-bb6da749b3ea: created successfully Jul 22 20:38:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 11dcb11c-0f68-4900-bc6f-bb6da749b3ea: deleting Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 11dcb11c-0f68-4900-bc6f-bb6da749b3ea: deleting {{(pid=87818) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-6110f494-288d-42a1-85d3-64c3a9dfc79a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-6110f494-288d-42a1-85d3-64c3a9dfc79a" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-5969bb9c-e788-4106-a6f2-c79f1b8decd1" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-5969bb9c-e788-4106-a6f2-c79f1b8decd1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Deleting offline snapshot 5969bb9c-e788-4106-a6f2-c79f1b8decd1 of volume 6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] snapshot_file for this snap is: volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfdcbb8-62ae-4d38-af81-660556d5e6a9]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:01 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 Jul 22 20:38:01 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:01 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1" returned: 0 in 0.489s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6110f494-288d-42a1-85d3-64c3a9dfc79a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:38:01 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[016ce1ad-1b80-49db-aa23-d0a5512e48d2]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:01 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a Jul 22 20:38:01 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:01 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a" returned: 0 in 0.499s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:02 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 Jul 22 20:38:02 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:02 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1" returned: 0 in 0.450s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:02 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1 Jul 22 20:38:02 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:02 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a.5969bb9c-e788-4106-a6f2-c79f1b8decd1" returned: 0 in 0.390s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-5969bb9c-e788-4106-a6f2-c79f1b8decd1" released by "_delete_snapshot" :: held 2.008s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-6110f494-288d-42a1-85d3-64c3a9dfc79a" released by "delete_snapshot" :: held 2.050s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-ec7a85de-99bb-4110-b31b-4e52f66f3d85" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-ec7a85de-99bb-4110-b31b-4e52f66f3d85" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-e2d21b34-e7c9-443d-a78e-146c45ef9562" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-e2d21b34-e7c9-443d-a78e-146c45ef9562" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Deleting offline snapshot e2d21b34-e7c9-443d-a78e-146c45ef9562 of volume ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:38:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] snapshot_file for this snap is: volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:38:03 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f29e41-8bdd-465e-875f-89bd3df1b06f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:03 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 Jul 22 20:38:03 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:03 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562" returned: 0 in 0.441s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:38:03 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4706c113-d600-4c40-985f-1ab831a44fe3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:03 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 Jul 22 20:38:03 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:04 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85" returned: 0 in 0.469s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:04 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 Jul 22 20:38:04 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:04 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562" returned: 0 in 0.446s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:04 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562 Jul 22 20:38:04 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:05 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85.e2d21b34-e7c9-443d-a78e-146c45ef9562" returned: 0 in 0.576s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-e2d21b34-e7c9-443d-a78e-146c45ef9562" released by "_delete_snapshot" :: held 2.123s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-ec7a85de-99bb-4110-b31b-4e52f66f3d85" released by "delete_snapshot" :: held 2.171s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:05 devstack cinder-volume[87818]: WARNING cinder.quota [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-216514412 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-216514412, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:38:05 devstack cinder-volume[87818]: WARNING cinder.quota [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-216514412 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-216514412, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:38:05 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['82380777-b535-4c36-b8d1-4a1b7bda8cc4', '490b89d6-b3f5-4738-abd7-99c30fad3577', 'afa9f007-21fd-4439-856b-3f223399fdca', '3c23cf39-bfb7-4202-a60e-d8f98b9b4c0e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:05 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['cc3e9d8a-d0ad-44ec-9909-7e52f9453944', 'c4e84e1c-2761-490d-9cf3-a352d9eb7536', '2c0f7c26-a759-4a9b-a93a-dd14e52e4163', '474e45d6-517e-4a09-bd46-c29391714cab'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2456a126-5dac-4118-a4a6-929ab032bd4d tempest-GroupSnapshotsTest-1142983477 None] group_snapshot 11dcb11c-0f68-4900-bc6f-bb6da749b3ea: deleted successfully Jul 22 20:38:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-4ba9913e-110e-4ed9-97d3-2a9a9af7a832 req-3e5a9e1b-095b-44e0-ba53-2532e906b5ce tempest-TaggedAttachmentsTest-1218120544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-4ba9913e-110e-4ed9-97d3-2a9a9af7a832 req-3e5a9e1b-095b-44e0-ba53-2532e906b5ce tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-4ba9913e-110e-4ed9-97d3-2a9a9af7a832 req-3e5a9e1b-095b-44e0-ba53-2532e906b5ce tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-4ba9913e-110e-4ed9-97d3-2a9a9af7a832 req-3e5a9e1b-095b-44e0-ba53-2532e906b5ce tempest-TaggedAttachmentsTest-1218120544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa28b170-a3aa-4823-84d3-e277cd435a9f', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:38:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-4ba9913e-110e-4ed9-97d3-2a9a9af7a832 req-3e5a9e1b-095b-44e0-ba53-2532e906b5ce tempest-TaggedAttachmentsTest-1218120544 None] attachment_update completed successfully. Jul 22 20:38:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-6110f494-288d-42a1-85d3-64c3a9dfc79a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-6110f494-288d-42a1-85d3-64c3a9dfc79a" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:07 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d547b38-6a59-4f61-a8fd-8bcf47302ae6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:07 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a Jul 22 20:38:07 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:07 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a" returned: 0 in 0.578s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:07 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a Jul 22 20:38:07 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:08 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6110f494-288d-42a1-85d3-64c3a9dfc79a" returned: 0 in 0.694s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-6110f494-288d-42a1-85d3-64c3a9dfc79a" released by "delete_volume" :: held 1.402s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-ec7a85de-99bb-4110-b31b-4e52f66f3d85" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-ec7a85de-99bb-4110-b31b-4e52f66f3d85" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[587606bd-6313-4a18-8a2d-4204301fed03]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:08 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 Jul 22 20:38:08 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:09 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85" returned: 0 in 0.736s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:09 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85 Jul 22 20:38:09 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:09 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ec7a85de-99bb-4110-b31b-4e52f66f3d85" returned: 0 in 0.334s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-ec7a85de-99bb-4110-b31b-4e52f66f3d85" released by "delete_volume" :: held 1.178s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:09 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['1236a49b-476c-4f7a-817e-eff0b9b3fef8'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:09 devstack cinder-volume[87818]: WARNING cinder.quota [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-216514412 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-216514412, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:38:09 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['843e37ac-76b6-4211-83a9-47e91ea16ccf', 'e0c81070-fb8d-4dc8-99c2-4de5b9fef12a', '22465d49-28e4-42a4-b745-7d05497e751a', 'b5665532-40ce-4553-8e4a-2b0de82383cf'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['ba4eab7e-29c6-4bf8-882c-4fa5da6aa4d9', 'e4270e6c-1fe8-4c01-bf87-086af31722a2', '5c5a1473-091e-4981-a181-70a2dd71fc73', '062bf691-5437-43af-93da-58d3e46cf5d6'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:10 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:38:10 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:10 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:38:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3d0083a5-6b12-43a5-9a81-04c36ffaa70d tempest-GroupSnapshotsTest-1142983477 None] Delete group completed successfully. Jul 22 20:38:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-0b7b8d5b-3bb2-4525-a93d-57c78456ba31 req-2e87457d-7c54-4a51-ad31-24fea9858a79 tempest-TaggedAttachmentsTest-1218120544 None] Terminate volume connection completed successfully. Jul 22 20:38:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-0b7b8d5b-3bb2-4525-a93d-57c78456ba31 req-2e87457d-7c54-4a51-ad31-24fea9858a79 tempest-TaggedAttachmentsTest-1218120544 None] Deleting attachment fa28b170-a3aa-4823-84d3-e277cd435a9f. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:38:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bdd0471d-efb7-4157-9084-a7696f6a90d1 tempest-GroupSnapshotsTest-1142983477 None] Group tempest-GroupSnapshotsTest-Group-972185593: creating Jul 22 20:38:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bdd0471d-efb7-4157-9084-a7696f6a90d1 tempest-GroupSnapshotsTest-1142983477 None] Group tempest-GroupSnapshotsTest-Group-972185593: created successfully Jul 22 20:38:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bdd0471d-efb7-4157-9084-a7696f6a90d1 tempest-GroupSnapshotsTest-1142983477 None] Create group completed successfully. Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (f3db0547-68c0-4676-9671-d69a22f02fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc94e29-ee07-40af-9986-20f5b141bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc94e29-ee07-40af-9986-20f5b141bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1108311626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c6ddc1d-f435-4c2e-b862-0893ba9d2765,host='devstack@QuobyteHD#QuobyteHD',id=52ca4d41-75a9-4aa2-8d45-3f361eba33d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:38:14Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da485f0c-9f79-48a3-bfb5-b428b4efd925),volume_type_id=da485f0c-9f79-48a3-bfb5-b428b4efd925)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a965c3fd-5c65-4fd1-87a4-d5e2c3fe91e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a965c3fd-5c65-4fd1-87a4-d5e2c3fe91e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44ee5a7-220d-46aa-9c9a-109fd25a389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44ee5a7-220d-46aa-9c9a-109fd25a389a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ca4d41-75a9-4aa2-8d45-3f361eba33d7', 'volume_name': 'volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2904a448-a582-4fae-b258-848b2b665fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2904a448-a582-4fae-b258-848b2b665fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d28a9c9-b31c-44fc-a3b9-6c9f84f649d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Volume 52ca4d41-75a9-4aa2-8d45-3f361eba33d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7', 'volume_size': 1} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c6ddc1d-f435-4c2e-b862-0893ba9d2765,created_at=2026-07-22T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1108311626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c6ddc1d-f435-4c2e-b862-0893ba9d2765,host='devstack@QuobyteHD#QuobyteHD',id=52ca4d41-75a9-4aa2-8d45-3f361eba33d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b9fd9bd31c401fa12d3395a1d1aa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:38:14Z,use_quota=True,user_id='586c3c04f9d748e5bebda14f9dbc5c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da485f0c-9f79-48a3-bfb5-b428b4efd925),volume_type_id=da485f0c-9f79-48a3-bfb5-b428b4efd925)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Creating volume 52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:38:13 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:38:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:13 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 1073741824 Jul 22 20:38:13 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:14 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 1073741824" returned: 0 in 0.569s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:14 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 Jul 22 20:38:14 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:14 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d28a9c9-b31c-44fc-a3b9-6c9f84f649d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95104d79-da56-446b-b9de-c8c0201b908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Volume volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 (52ca4d41-75a9-4aa2-8d45-3f361eba33d7): created successfully Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95104d79-da56-446b-b9de-c8c0201b908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Flow 'volume_create_manager' (f3db0547-68c0-4676-9671-d69a22f02fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:38:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-36b052f6-e164-453a-9ce2-38ab669595cd tempest-GroupSnapshotsTest-1142983477 None] Created volume successfully. Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-13789865-5969-4dbe-bcf7-9b33df68e4a3 req-71b7782f-1a00-45eb-9a7b-5e11e7fc15ed tempest-ServerActionsTestOtherA-425644103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-13789865-5969-4dbe-bcf7-9b33df68e4a3 req-71b7782f-1a00-45eb-9a7b-5e11e7fc15ed tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-13789865-5969-4dbe-bcf7-9b33df68e4a3 req-71b7782f-1a00-45eb-9a7b-5e11e7fc15ed tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-13789865-5969-4dbe-bcf7-9b33df68e4a3 req-71b7782f-1a00-45eb-9a7b-5e11e7fc15ed tempest-ServerActionsTestOtherA-425644103 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-970bdf03-fb86-484e-97cb-e81ba6369629', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b9f18d8-f229-4511-adc7-68ed2953c6dd', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:38:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-13789865-5969-4dbe-bcf7-9b33df68e4a3 req-71b7782f-1a00-45eb-9a7b-5e11e7fc15ed tempest-ServerActionsTestOtherA-425644103 None] attachment_update completed successfully. Jul 22 20:38:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] GroupSnapshot a3516e81-abf6-4adc-bba8-0fcfc2f31d23: creating. Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Group snapshot a3516e81-abf6-4adc-bba8-0fcfc2f31d23: creating. {{(pid=87818) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Creating offline snapshot 8baa5a49-e6e6-4707-ac6d-6ff9d9349473 of volume 52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:38:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[93264d10-5bea-4b78-928a-8890d13ed48d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:17 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 Jul 22 20:38:17 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:17 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" returned: 0 in 0.467s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:17 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 1G Jul 22 20:38:17 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:18 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 1G" returned: 0 in 0.639s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:18 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 Jul 22 20:38:18 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:18 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473" returned: 0 in 0.422s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:18 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:38:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:18 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 Jul 22 20:38:18 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:19 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473" returned: 0 in 0.575s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:19 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.info Jul 22 20:38:19 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:19 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.info" returned: 0 in 0.327s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:19 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:38:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:19 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.info Jul 22 20:38:19 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:19 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.info" returned: 0 in 0.478s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.105s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:20 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cb9e92db-18cf-49f7-a48a-e63f405a830f tempest-GroupSnapshotsTest-1142983477 None] group_snapshot a3516e81-abf6-4adc-bba8-0fcfc2f31d23: created successfully Jul 22 20:38:20 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-718d08a1-b728-4849-a3dd-40d29f47eca8 req-7881cfc8-8244-4fa9-8d70-ef5e0b481cda tempest-ServerActionsTestOtherA-425644103 None] Terminate volume connection completed successfully. Jul 22 20:38:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-718d08a1-b728-4849-a3dd-40d29f47eca8 req-7881cfc8-8244-4fa9-8d70-ef5e0b481cda tempest-ServerActionsTestOtherA-425644103 None] Deleting attachment 5b9f18d8-f229-4511-adc7-68ed2953c6dd. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:38:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] group_snapshot a3516e81-abf6-4adc-bba8-0fcfc2f31d23: deleting Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] group_snapshot a3516e81-abf6-4adc-bba8-0fcfc2f31d23: deleting {{(pid=87818) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-8baa5a49-e6e6-4707-ac6d-6ff9d9349473" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-8baa5a49-e6e6-4707-ac6d-6ff9d9349473" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Deleting offline snapshot 8baa5a49-e6e6-4707-ac6d-6ff9d9349473 of volume 52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] snapshot_file for this snap is: volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9fd01b-cefc-49d4-b001-333b04a726f0]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-718d08a1-b728-4849-a3dd-40d29f47eca8 req-46756d6d-5d9b-4a78-83f4-1ca097378090 tempest-ServerActionsTestOtherA-425644103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-718d08a1-b728-4849-a3dd-40d29f47eca8 req-46756d6d-5d9b-4a78-83f4-1ca097378090 tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-718d08a1-b728-4849-a3dd-40d29f47eca8 req-46756d6d-5d9b-4a78-83f4-1ca097378090 tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:22 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 Jul 22 20:38:22 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-718d08a1-b728-4849-a3dd-40d29f47eca8 req-46756d6d-5d9b-4a78-83f4-1ca097378090 tempest-ServerActionsTestOtherA-425644103 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-970bdf03-fb86-484e-97cb-e81ba6369629', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '236f200b-6285-4548-82ea-b3522232503a', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:38:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-718d08a1-b728-4849-a3dd-40d29f47eca8 req-46756d6d-5d9b-4a78-83f4-1ca097378090 tempest-ServerActionsTestOtherA-425644103 None] attachment_update completed successfully. Jul 22 20:38:22 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473" returned: 0 in 0.569s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de13af3-06ee-4c0b-bc6a-469ee329384f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:22 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 Jul 22 20:38:22 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:23 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" returned: 0 in 0.575s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:23 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 Jul 22 20:38:23 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Acquiring lock "cinder-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Lock "cinder-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:23 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473" returned: 0 in 0.588s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Acquiring lock "cinder-quobyte-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:23 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473 Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Lock "cinder-quobyte-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:23 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a90bdd-0991-4cac-bdc3-a9b55a4fd8d7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:23 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 Jul 22 20:38:23 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:23 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7.8baa5a49-e6e6-4707-ac6d-6ff9d9349473" returned: 0 in 0.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-8baa5a49-e6e6-4707-ac6d-6ff9d9349473" released by "_delete_snapshot" :: held 2.249s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" released by "delete_snapshot" :: held 2.282s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:24 devstack cinder-volume[87818]: WARNING cinder.quota [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2113656360 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2113656360, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:38:24 devstack cinder-volume[87818]: WARNING cinder.quota [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2113656360 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2113656360, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['b6c61095-12ff-4c25-94d4-0f9878afe880', 'acd65d50-f4ed-4883-89af-b36dece11a7b', '7eb619bc-37da-409c-a4f6-417088fd9954', '416a76c3-511b-4504-ac2b-54156604d2cf'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a50c256e-2cb0-49cd-8700-73ef2db876e8 tempest-GroupSnapshotsTest-1142983477 None] group_snapshot a3516e81-abf6-4adc-bba8-0fcfc2f31d23: deleted successfully Jul 22 20:38:24 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2" returned: 0 in 0.589s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:24 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2 Jul 22 20:38:24 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:24 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2" returned: 0 in 0.339s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Lock "cinder-quobyte-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2" released by "delete_volume" :: held 0.994s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Created reservations ['97e67cec-a13a-465f-90a2-1cf73a120dc2', '928dd855-975d-4bff-a3df-aa0640fda388', '8d910b1d-e550-4349-9234-4d6cb38cd206', 'd7987dbe-5512-47e2-9fa2-c098a79b7aff'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:24 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:38:24 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:25 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.308s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:25 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:38:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Deleted volume successfully. Jul 22 20:38:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d799da5-5e7c-4004-842c-71a4c2a06c20 tempest-TaggedAttachmentsTest-1218120544 None] Lock "cinder-698e0a00-9dc5-4c07-b89d-384d9f6ac4c2-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "cinder-quobyte-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:38:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:38:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97b09d6-381d-494d-bc43-e150bb3291d8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:38:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:25 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 Jul 22 20:38:25 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:26 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" returned: 0 in 0.549s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:26 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7 Jul 22 20:38:26 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:26 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" returned: 0 in 0.310s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Lock "cinder-quobyte-52ca4d41-75a9-4aa2-8d45-3f361eba33d7" released by "delete_volume" :: held 0.934s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['6bf3a9a9-32cd-4166-b8b7-a1d4c7210ede'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:26 devstack cinder-volume[87818]: WARNING cinder.quota [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2113656360 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2113656360, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Created reservations ['dd044e06-cb39-4b4d-949a-6cc2cb223704', '6dafe97a-874c-4759-b935-8e2ac62a8272', '6e9cfbf1-ce8c-413a-9fe0-ffc91977dbf5', '8641943c-2526-4be9-9964-90bb4afd86ed'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:26 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:38:26 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:27 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.388s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:27 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:38:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4694c054-8324-4fb5-bc70-ec087c4c4d49 tempest-GroupSnapshotsTest-1142983477 None] Delete group completed successfully. Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Flow 'volume_create_manager' (16515759-1bb6-4fe1-b7c8-441f7e31f7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f290dd-c761-4f9a-a0d3-2fa02a9d1bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f290dd-c761-4f9a-a0d3-2fa02a9d1bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1150564345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f13ae9-3fda-4758-98f4-4fed7045dfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f96e16e56405aab9aad521a8c8ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:38:35Z,use_quota=True,user_id='b0efe511cdd6479e98606c930ebc17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d7407-add3-4dfb-8cb8-fbc3d741a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d7407-add3-4dfb-8cb8-fbc3d741a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c14c23-a27c-4404-b0e7-4287bb0a6db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c14c23-a27c-4404-b0e7-4287bb0a6db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f13ae9-3fda-4758-98f4-4fed7045dfdb', 'volume_name': 'volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0181adf-24d6-4071-a77e-8e7910fc1225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0181adf-24d6-4071-a77e-8e7910fc1225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d191bc-cfb9-40c7-b11a-9928589750f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:35 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Volume 39f13ae9-3fda-4758-98f4-4fed7045dfdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb', 'volume_size': 1} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1150564345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f13ae9-3fda-4758-98f4-4fed7045dfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f96e16e56405aab9aad521a8c8ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:38:35Z,use_quota=True,user_id='b0efe511cdd6479e98606c930ebc17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Creating volume 39f13ae9-3fda-4758-98f4-4fed7045dfdb {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:38:35 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:35 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb 1073741824 Jul 22 20:38:35 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:35 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb 1073741824" returned: 0 in 0.583s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:35 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb Jul 22 20:38:35 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:36 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb" returned: 0 in 0.459s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:38:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d191bc-cfb9-40c7-b11a-9928589750f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f80ad43-d9e0-422b-9f57-2d37854287ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:38:36 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Volume volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb (39f13ae9-3fda-4758-98f4-4fed7045dfdb): created successfully Jul 22 20:38:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f80ad43-d9e0-422b-9f57-2d37854287ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:38:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Flow 'volume_create_manager' (16515759-1bb6-4fe1-b7c8-441f7e31f7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:38:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-536fa776-19ff-4cb1-8400-8fff94373c92 tempest-AttachVolumeTestJSON-1175768797 None] Created volume successfully. Jul 22 20:38:38 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=111,cinder:UPDATE=91,cinder:INSERT=20,cinder:DELETE=2 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:38:38 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=108,cinder:UPDATE=102,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:38:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6b586c5f-d001-4ee5-be9c-e5241478b0d6 req-6793fd67-525f-4280-be4b-dda57e3655b8 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6b586c5f-d001-4ee5-be9c-e5241478b0d6 req-6793fd67-525f-4280-be4b-dda57e3655b8 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6b586c5f-d001-4ee5-be9c-e5241478b0d6 req-6793fd67-525f-4280-be4b-dda57e3655b8 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-6b586c5f-d001-4ee5-be9c-e5241478b0d6 req-6793fd67-525f-4280-be4b-dda57e3655b8 tempest-AttachVolumeTestJSON-1175768797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a9789a6-dd91-485e-9e67-65d89c813f33', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:38:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-6b586c5f-d001-4ee5-be9c-e5241478b0d6 req-6793fd67-525f-4280-be4b-dda57e3655b8 tempest-AttachVolumeTestJSON-1175768797 None] attachment_update completed successfully. Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:38:41 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:38:41 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:38:41 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.304s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 8 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:38:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:38:48 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:38:48 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:38:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-4a0062fe-bb61-4172-8a87-6084099142c8 req-00fdb968-f3b4-4eb6-af15-ace3493a9faf tempest-ServerActionsTestOtherA-425644103 None] Terminate volume connection completed successfully. Jul 22 20:38:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-4a0062fe-bb61-4172-8a87-6084099142c8 req-00fdb968-f3b4-4eb6-af15-ace3493a9faf tempest-ServerActionsTestOtherA-425644103 None] Deleting attachment 236f200b-6285-4548-82ea-b3522232503a. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:39:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Acquiring lock "cinder-970bdf03-fb86-484e-97cb-e81ba6369629-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Lock "cinder-970bdf03-fb86-484e-97cb-e81ba6369629-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Acquiring lock "cinder-quobyte-970bdf03-fb86-484e-97cb-e81ba6369629" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Lock "cinder-quobyte-970bdf03-fb86-484e-97cb-e81ba6369629" acquired by "delete_volume" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:03 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1564192-5762-43d4-913d-91f093d5fd62]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:03 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 Jul 22 20:39:03 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:03 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629" returned: 0 in 0.512s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:03 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629 Jul 22 20:39:03 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:04 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-970bdf03-fb86-484e-97cb-e81ba6369629" returned: 0 in 0.348s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Lock "cinder-quobyte-970bdf03-fb86-484e-97cb-e81ba6369629" released by "delete_volume" :: held 0.927s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Created reservations ['178a1ff2-a5b1-4d60-b52b-1c8e3364076e', '339579f5-75b0-42f4-b089-d229fffe6462', 'babab595-83be-4c54-898f-6b015d3e28d5', 'e4815a91-bee4-4566-9742-e1418f719aa7'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:04 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:39:04 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Flow 'volume_create_manager' (2bd5bbe7-4daf-408d-bc97-ef24fba65b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003d7051-4b87-417f-a2a0-c4956c68950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003d7051-4b87-417f-a2a0-c4956c68950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-252781363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba71510-8425-4fff-91d3-e889802b4382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b1ec49fa034091b3c9ec43584027cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:04Z,use_quota=True,user_id='7665fa115eac4343887d3d352de7d337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07112d7-9218-4d7e-94f6-b2b6f53a344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07112d7-9218-4d7e-94f6-b2b6f53a344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fa559b-00b4-4acc-80a3-1853f1622f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fa559b-00b4-4acc-80a3-1853f1622f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba71510-8425-4fff-91d3-e889802b4382', 'volume_name': 'volume-5ba71510-8425-4fff-91d3-e889802b4382', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bce7f2e-8b0f-4426-8697-3abf9c6daac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bce7f2e-8b0f-4426-8697-3abf9c6daac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a8a445-1860-4f1a-bbdb-624683d45d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:04 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Volume 5ba71510-8425-4fff-91d3-e889802b4382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba71510-8425-4fff-91d3-e889802b4382', 'volume_size': 1} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-252781363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba71510-8425-4fff-91d3-e889802b4382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b1ec49fa034091b3c9ec43584027cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:04Z,use_quota=True,user_id='7665fa115eac4343887d3d352de7d337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Creating volume 5ba71510-8425-4fff-91d3-e889802b4382 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:04 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:04 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 1073741824 Jul 22 20:39:04 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:04 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.342s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:39:04 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Deleted volume successfully. Jul 22 20:39:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edc48bd1-c6fe-4ed6-b8bd-f311dfd195fc tempest-ServerActionsTestOtherA-425644103 None] Lock "cinder-970bdf03-fb86-484e-97cb-e81ba6369629-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:05 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 1073741824" returned: 0 in 0.570s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:05 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 Jul 22 20:39:05 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:05 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a8a445-1860-4f1a-bbdb-624683d45d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba71510-8425-4fff-91d3-e889802b4382', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb38ca7-5e32-4c3a-9262-558f29f072f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Volume volume-5ba71510-8425-4fff-91d3-e889802b4382 (5ba71510-8425-4fff-91d3-e889802b4382): created successfully Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb38ca7-5e32-4c3a-9262-558f29f072f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Flow 'volume_create_manager' (2bd5bbe7-4daf-408d-bc97-ef24fba65b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-06f330c1-58d5-47a3-84ab-41f2d0725712 tempest-VolumesServicesTestJSON-532138791 None] Created volume successfully. Jul 22 20:39:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Acquiring lock "cinder-5ba71510-8425-4fff-91d3-e889802b4382-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Lock "cinder-5ba71510-8425-4fff-91d3-e889802b4382-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Acquiring lock "cinder-quobyte-5ba71510-8425-4fff-91d3-e889802b4382" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Lock "cinder-quobyte-5ba71510-8425-4fff-91d3-e889802b4382" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[104fcaa1-0354-40eb-bebe-b380468f2ac0]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:07 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 Jul 22 20:39:07 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:07 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382" returned: 0 in 0.691s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:07 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382 Jul 22 20:39:07 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:08 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5ba71510-8425-4fff-91d3-e889802b4382" returned: 0 in 0.519s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Lock "cinder-quobyte-5ba71510-8425-4fff-91d3-e889802b4382" released by "delete_volume" :: held 1.297s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Created reservations ['78bb530f-1cb6-4fd1-aa35-e437c10e7334', '16339c36-7ded-408a-8526-72ad6debe224', 'a84ba89e-f843-424d-8eb1-76616f6b285f', '6b1a91af-a997-4017-b63e-6ca4abea4020'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:08 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:39:08 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:08 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.440s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:39:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Deleted volume successfully. Jul 22 20:39:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ebc7678a-5a6a-45ca-be7c-9fc9665ed261 tempest-VolumesServicesTestJSON-532138791 None] Lock "cinder-5ba71510-8425-4fff-91d3-e889802b4382-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-3899efcf-bf16-4684-bf35-c17e54a36df3 req-7116b868-a683-460c-8ce5-ebfb7fcb1027 tempest-AttachVolumeTestJSON-1175768797 None] Terminate volume connection completed successfully. Jul 22 20:39:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-3899efcf-bf16-4684-bf35-c17e54a36df3 req-7116b868-a683-460c-8ce5-ebfb7fcb1027 tempest-AttachVolumeTestJSON-1175768797 None] Deleting attachment 0a9789a6-dd91-485e-9e67-65d89c813f33. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:39:18 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=12,cinder:INSERT=8,cinder:UPDATE=16,cinder:DELETE=3 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:39:20 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Flow 'volume_create_manager' (5ac671e2-3554-450c-ba6b-296599bbd77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381be9bc-b0eb-4de4-8f39-4854c3733347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381be9bc-b0eb-4de4-8f39-4854c3733347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1839911520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe512ba3-cde5-468d-9ecf-683660221d95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e40e39f14164b4a81c1057ecf22e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:22Z,use_quota=True,user_id='f064edcf49534225bdc3a0ba272cfe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819330d7-124e-4965-817d-6b77cc276d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819330d7-124e-4965-817d-6b77cc276d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98db42-2289-4b67-9370-bae52aa5ea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98db42-2289-4b67-9370-bae52aa5ea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe512ba3-cde5-468d-9ecf-683660221d95', 'volume_name': 'volume-fe512ba3-cde5-468d-9ecf-683660221d95', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfbcac1-d003-4791-9753-f2df559a12a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfbcac1-d003-4791-9753-f2df559a12a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152945c0-8bf3-45bd-adf4-df544d7e7e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:21 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Volume fe512ba3-cde5-468d-9ecf-683660221d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe512ba3-cde5-468d-9ecf-683660221d95', 'volume_size': 1} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1839911520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe512ba3-cde5-468d-9ecf-683660221d95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e40e39f14164b4a81c1057ecf22e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:22Z,use_quota=True,user_id='f064edcf49534225bdc3a0ba272cfe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Creating volume fe512ba3-cde5-468d-9ecf-683660221d95 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:21 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:21 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 1073741824 Jul 22 20:39:21 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:22 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 1073741824" returned: 0 in 0.469s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:22 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 Jul 22 20:39:22 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:22 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152945c0-8bf3-45bd-adf4-df544d7e7e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe512ba3-cde5-468d-9ecf-683660221d95', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0ea632-e0fa-4261-a57c-fae0170a2d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:22 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Volume volume-fe512ba3-cde5-468d-9ecf-683660221d95 (fe512ba3-cde5-468d-9ecf-683660221d95): created successfully Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0ea632-e0fa-4261-a57c-fae0170a2d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Flow 'volume_create_manager' (5ac671e2-3554-450c-ba6b-296599bbd77a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9bc6e2d0-c8fa-414a-81fe-f6a5be271f3d tempest-VolumesTestJSON-26115261 None] Created volume successfully. Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Flow 'volume_create_manager' (d18a4886-e8fe-4d30-bc8a-ee9095231954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2c73e2-5f7b-452e-b08b-879960d80e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2c73e2-5f7b-452e-b08b-879960d80e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1722789502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f352946c-0774-465c-923a-766a53442f0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e40e39f14164b4a81c1057ecf22e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:24Z,use_quota=True,user_id='f064edcf49534225bdc3a0ba272cfe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d381ca2-569d-49d7-9dcc-f063a167e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d381ca2-569d-49d7-9dcc-f063a167e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14e183-dafa-4c6f-9f8d-c5d09f904816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14e183-dafa-4c6f-9f8d-c5d09f904816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f352946c-0774-465c-923a-766a53442f0f', 'volume_name': 'volume-f352946c-0774-465c-923a-766a53442f0f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc0f501-fbe7-481d-9aa0-89c04c8547cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc0f501-fbe7-481d-9aa0-89c04c8547cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37257907-7366-4eaf-814d-d7dd68e2fa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:24 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Volume f352946c-0774-465c-923a-766a53442f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f352946c-0774-465c-923a-766a53442f0f', 'volume_size': 1} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1722789502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f352946c-0774-465c-923a-766a53442f0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e40e39f14164b4a81c1057ecf22e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:24Z,use_quota=True,user_id='f064edcf49534225bdc3a0ba272cfe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Creating volume f352946c-0774-465c-923a-766a53442f0f {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:24 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:24 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f 1073741824 Jul 22 20:39:24 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:25 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f 1073741824" returned: 0 in 0.597s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:25 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f Jul 22 20:39:25 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:25 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f" returned: 0 in 0.393s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37257907-7366-4eaf-814d-d7dd68e2fa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f352946c-0774-465c-923a-766a53442f0f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dc88f7-1223-43b0-bf2b-2c1122998e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Volume volume-f352946c-0774-465c-923a-766a53442f0f (f352946c-0774-465c-923a-766a53442f0f): created successfully Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dc88f7-1223-43b0-bf2b-2c1122998e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Flow 'volume_create_manager' (d18a4886-e8fe-4d30-bc8a-ee9095231954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-965ebb27-59fd-4914-9db0-3f32d8f8f51c tempest-VolumesTestJSON-26115261 None] Created volume successfully. Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Flow 'volume_create_manager' (7b3c9d3b-69f2-4cf8-880e-b00c06380ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991b0dbc-fad3-4976-9671-89778dcf5724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991b0dbc-fad3-4976-9671-89778dcf5724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2042203865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1666fe1e-a4c7-4657-b780-46fd7240efbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e40e39f14164b4a81c1057ecf22e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:27Z,use_quota=True,user_id='f064edcf49534225bdc3a0ba272cfe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1f764b-6b8f-4887-9483-9039ca105558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1f764b-6b8f-4887-9483-9039ca105558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d175279-0b5c-45c8-b671-37ec1d1d1acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d175279-0b5c-45c8-b671-37ec1d1d1acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1666fe1e-a4c7-4657-b780-46fd7240efbe', 'volume_name': 'volume-1666fe1e-a4c7-4657-b780-46fd7240efbe', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ce13a2-5d32-4b95-8502-a6d35e1bdfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ce13a2-5d32-4b95-8502-a6d35e1bdfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df581d37-7cc3-45d1-b268-86b517efe95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:27 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Volume 1666fe1e-a4c7-4657-b780-46fd7240efbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1666fe1e-a4c7-4657-b780-46fd7240efbe', 'volume_size': 1} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2042203865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1666fe1e-a4c7-4657-b780-46fd7240efbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e40e39f14164b4a81c1057ecf22e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:27Z,use_quota=True,user_id='f064edcf49534225bdc3a0ba272cfe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Creating volume 1666fe1e-a4c7-4657-b780-46fd7240efbe {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:27 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:27 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe 1073741824 Jul 22 20:39:27 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:27 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe 1073741824" returned: 0 in 0.462s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:27 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe Jul 22 20:39:27 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:28 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe" returned: 0 in 0.273s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df581d37-7cc3-45d1-b268-86b517efe95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1666fe1e-a4c7-4657-b780-46fd7240efbe', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971023a8-fec4-4c9f-a174-63374b7c35d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Volume volume-1666fe1e-a4c7-4657-b780-46fd7240efbe (1666fe1e-a4c7-4657-b780-46fd7240efbe): created successfully Jul 22 20:39:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971023a8-fec4-4c9f-a174-63374b7c35d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Flow 'volume_create_manager' (7b3c9d3b-69f2-4cf8-880e-b00c06380ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e538aeda-126e-4bc0-9237-d3b72bb40789 tempest-VolumesTestJSON-26115261 None] Created volume successfully. Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Flow 'volume_create_manager' (4145bbc9-b780-4ab5-a9ef-8453f9b3abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42c7f55-2cfb-4da1-883f-5686a9ec3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42c7f55-2cfb-4da1-883f-5686a9ec3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1161954884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfb2762-9479-4e24-8bd3-e3ffee1543df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91720a14ee184f59863c2bffeb780faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:29Z,use_quota=True,user_id='9838019bc61c4ed7a3c1a3f36fb0eb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e274804-82c4-445d-869c-03c46ac2fc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e274804-82c4-445d-869c-03c46ac2fc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e76eab-db23-4d08-8265-d4388c153d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Flow 'volume_create_manager' (6b335ec8-c03a-4dce-a89d-c4c21cc8533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e09a1d-05ab-45de-bc00-158ca86873a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e09a1d-05ab-45de-bc00-158ca86873a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-460778369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb73551-ecd1-4cd8-aad5-885c06277d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145bdb28601f4d7a88a55bd80fe79411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:30Z,use_quota=True,user_id='793f6121e1f64db5a2652ffd01df0b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e6832b-d294-4669-828f-e4c51e5af2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e6832b-d294-4669-828f-e4c51e5af2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd656328-1c85-4652-8a9e-228c7b2c9545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd656328-1c85-4652-8a9e-228c7b2c9545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb73551-ecd1-4cd8-aad5-885c06277d3a', 'volume_name': 'volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a6300c-fcb7-44d8-9b94-29f1b6a99ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a6300c-fcb7-44d8-9b94-29f1b6a99ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c7189a-5dfa-488f-8ff4-50d975b21c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:30 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Volume 2cb73551-ecd1-4cd8-aad5-885c06277d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a', 'volume_size': 1} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-460778369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb73551-ecd1-4cd8-aad5-885c06277d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145bdb28601f4d7a88a55bd80fe79411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:30Z,use_quota=True,user_id='793f6121e1f64db5a2652ffd01df0b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Creating volume 2cb73551-ecd1-4cd8-aad5-885c06277d3a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:30 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:30 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a 1073741824 Jul 22 20:39:30 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e76eab-db23-4d08-8265-d4388c153d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4bfb2762-9479-4e24-8bd3-e3ffee1543df', 'volume_name': 'volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f749c2-3d17-4d54-aec6-c7725589489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f749c2-3d17-4d54-aec6-c7725589489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce06420d-2501-471f-b896-96739a9fdca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:30 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Volume 4bfb2762-9479-4e24-8bd3-e3ffee1543df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Trying to clone 4bfb2762-9479-4e24-8bd3-e3ffee1543df from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:39:30 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Image download 20.69 MB at 20.69 MB/s Jul 22 20:39:30 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a 1073741824" returned: 0 in 0.741s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c26e1f-b037-4542-988a-7f0394b4da72]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:31 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a Jul 22 20:39:31 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Acquiring lock "cinder-1666fe1e-a4c7-4657-b780-46fd7240efbe-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:31 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Lock "cinder-1666fe1e-a4c7-4657-b780-46fd7240efbe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:31 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Acquiring lock "cinder-quobyte-1666fe1e-a4c7-4657-b780-46fd7240efbe" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Lock "cinder-quobyte-1666fe1e-a4c7-4657-b780-46fd7240efbe" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f794c-49ee-4f5d-8644-a3094f416be5]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:31 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:31 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a" returned: 0 in 0.392s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 is fetched for user 9838019bc61c4ed7a3c1a3f36fb0eb62. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:39:31 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe Jul 22 20:39:31 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c7189a-5dfa-488f-8ff4-50d975b21c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8df2c4-008c-4c81-9c4d-7759b08684b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:31 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Volume volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a (2cb73551-ecd1-4cd8-aad5-885c06277d3a): created successfully Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8df2c4-008c-4c81-9c4d-7759b08684b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Flow 'volume_create_manager' (6b335ec8-c03a-4dce-a89d-c4c21cc8533e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ff03dbb6-29ca-4b6d-bb88-7316a9192f55 tempest-AttachVolumeShelveTestJSON-141035361 None] Created volume successfully. Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32cb123-1f0f-4284-997b-e138456ea7ad]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:31 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD Jul 22 20:39:31 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:31 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe" returned: 0 in 0.450s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:31 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe Jul 22 20:39:31 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:31 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1161954884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfb2762-9479-4e24-8bd3-e3ffee1543df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91720a14ee184f59863c2bffeb780faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:29Z,use_quota=True,user_id='9838019bc61c4ed7a3c1a3f36fb0eb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Creating volume 4bfb2762-9479-4e24-8bd3-e3ffee1543df {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:31 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:31 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df 1073741824 Jul 22 20:39:31 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:31 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1666fe1e-a4c7-4657-b780-46fd7240efbe" returned: 0 in 0.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Lock "cinder-quobyte-1666fe1e-a4c7-4657-b780-46fd7240efbe" released by "delete_volume" :: held 0.784s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Created reservations ['8c8946ab-d420-436c-8447-db3156d8f5d8', '3e2f6d14-b3e3-423b-911d-75c4175b50b2', '5164c827-6100-46f5-97d5-cc830c58d5ef', '0dace617-3a3e-4682-bf30-e17d4d01f165'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:32 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:39:32 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Acquiring lock "cinder-f352946c-0774-465c-923a-766a53442f0f-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Lock "cinder-f352946c-0774-465c-923a-766a53442f0f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Acquiring lock "cinder-quobyte-f352946c-0774-465c-923a-766a53442f0f" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Lock "cinder-quobyte-f352946c-0774-465c-923a-766a53442f0f" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0001adb-a897-4adf-994d-128a0f8f842d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:32 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:32 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df 1073741824" returned: 0 in 0.639s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.367s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:39:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Deleted volume successfully. Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f6f9095f-a3dd-4430-b4c0-403e01824b05 tempest-VolumesTestJSON-26115261 None] Lock "cinder-1666fe1e-a4c7-4657-b780-46fd7240efbe-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:32 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df Jul 22 20:39:32 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:32 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f Jul 22 20:39:32 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:32 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df" returned: 0 in 0.262s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Attempting download of 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume 4bfb2762-9479-4e24-8bd3-e3ffee1543df. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:39:32 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f" returned: 0 in 0.418s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3772ce74-8956-48d4-8173-75e9009933e1]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_7_01mp7o {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:32 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f Jul 22 20:39:32 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:33 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_7_01mp7o Jul 22 20:39:33 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:33 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f352946c-0774-465c-923a-766a53442f0f" returned: 0 in 0.285s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Lock "cinder-quobyte-f352946c-0774-465c-923a-766a53442f0f" released by "delete_volume" :: held 0.748s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Created reservations ['2236691a-fdf7-4276-8bd1-c639d266ac48', '0872fdb1-717d-4c22-8b7f-4df62807389b', '6c8adc4e-4766-445b-9eb8-f9cc507194af', '7133bf21-7df0-4635-b4db-5f12872a17b1'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:39:33 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_7_01mp7o" returned: 0 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_7_01mp7o {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:33 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:39:33 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:33 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_7_01mp7o Jul 22 20:39:33 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Acquiring lock "cinder-fe512ba3-cde5-468d-9ecf-683660221d95-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Lock "cinder-fe512ba3-cde5-468d-9ecf-683660221d95-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Acquiring lock "cinder-quobyte-fe512ba3-cde5-468d-9ecf-683660221d95" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Lock "cinder-quobyte-fe512ba3-cde5-468d-9ecf-683660221d95" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fea3c9-8cfc-4041-9398-6a1c2926da5c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:33 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_7_01mp7o" returned: 1 in 0.427s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_7_01mp7o' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[531b6d0e-8ef6-41b5-9cab-7c7fc5ddd41e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:33 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.399s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:39:33 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Deleted volume successfully. Jul 22 20:39:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4aae13d-19ba-495b-8863-5d693c04808a tempest-VolumesTestJSON-26115261 None] Lock "cinder-f352946c-0774-465c-923a-766a53442f0f-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:33 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 Jul 22 20:39:33 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:33 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD Jul 22 20:39:33 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:34 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:34 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95 Jul 22 20:39:34 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:34 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] 36543c2a-70aa-4e05-bb91-fc14ca93a149 was qcow2, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:34 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df Jul 22 20:39:34 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:34 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fe512ba3-cde5-468d-9ecf-683660221d95" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Lock "cinder-quobyte-fe512ba3-cde5-468d-9ecf-683660221d95" released by "delete_volume" :: held 0.745s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Created reservations ['4b6c6830-def4-48f1-8c29-4fea58f22256', '5224774d-3b33-4190-b234-3d469dfbe5a6', 'b89c6537-3ed8-42bf-8160-ccbb7f75c642', 'b485e718-2821-4ba2-8260-4642010df342'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:34 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:39:34 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:34 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:39:34 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Deleted volume successfully. Jul 22 20:39:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efdab33f-e43c-49b6-a9e1-e7365506e45d tempest-VolumesTestJSON-26115261 None] Lock "cinder-fe512ba3-cde5-468d-9ecf-683660221d95-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:36 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df" returned: 0 in 2.164s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_q_ce8krodevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:39:36 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Converted 112.00 MB image at 51.73 MB/s Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:36 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df 1G Jul 22 20:39:36 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:36 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df 1G" returned: 0 in 0.452s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Downloaded image 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume 4bfb2762-9479-4e24-8bd3-e3ffee1543df successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 for user 9838019bc61c4ed7a3c1a3f36fb0eb62 is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Marking volume 4bfb2762-9479-4e24-8bd3-e3ffee1543df as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Copying metadata from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 to 4bfb2762-9479-4e24-8bd3-e3ffee1543df. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Creating volume glance metadata for volume 4bfb2762-9479-4e24-8bd3-e3ffee1543df backed by image 36543c2a-70aa-4e05-bb91-fc14ca93a149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce06420d-2501-471f-b896-96739a9fdca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b176b2f2-d182-4124-87a5-369a6c2e6170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:36 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Volume volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df (4bfb2762-9479-4e24-8bd3-e3ffee1543df): created successfully Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b176b2f2-d182-4124-87a5-369a6c2e6170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Flow 'volume_create_manager' (4145bbc9-b780-4ab5-a9ef-8453f9b3abe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a5eb2c35-35d2-43db-9df0-f49edb06a507 tempest-VolumesImageMetadata-1901628335 None] Created volume successfully. Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Acquiring lock "cinder-4bfb2762-9479-4e24-8bd3-e3ffee1543df-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Lock "cinder-4bfb2762-9479-4e24-8bd3-e3ffee1543df-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Acquiring lock "cinder-quobyte-4bfb2762-9479-4e24-8bd3-e3ffee1543df" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Lock "cinder-quobyte-4bfb2762-9479-4e24-8bd3-e3ffee1543df" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[32304c59-6ac4-40af-b869-a2513f818ceb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:38 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df Jul 22 20:39:38 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:38 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df" returned: 0 in 0.484s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:38 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df Jul 22 20:39:38 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:39 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4bfb2762-9479-4e24-8bd3-e3ffee1543df" returned: 0 in 0.402s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Lock "cinder-quobyte-4bfb2762-9479-4e24-8bd3-e3ffee1543df" released by "delete_volume" :: held 0.948s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Created reservations ['18a6d9ba-210f-4001-a80e-158d0dff9e09', '3a578313-8b2f-4aeb-9a0a-49a36786f9cd', '60904a0e-f006-42f5-8d2c-0eaab21315a3', '696d3b25-a068-4fc1-92c3-992058352de7'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:39 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:39:39 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:39 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.359s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:39 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:39:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Deleted volume successfully. Jul 22 20:39:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdf3b305-07f0-4c67-9ab3-2e38ba31da15 tempest-VolumesImageMetadata-1901628335 None] Lock "cinder-4bfb2762-9479-4e24-8bd3-e3ffee1543df-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:41 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:39:41 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:41 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.311s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:39:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:39:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9ec36333-6c5f-454a-ada3-ade116c0bc8b req-0194359e-c602-4bb4-8303-504c10cc8568 tempest-AttachVolumeShelveTestJSON-141035361 None] No connector for attachment 2be9bec9-4a3a-4128-b205-df90d9dc7406; skipping storage backend terminate_connection call. {{(pid=87818) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 22 20:39:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9ec36333-6c5f-454a-ada3-ade116c0bc8b req-0194359e-c602-4bb4-8303-504c10cc8568 tempest-AttachVolumeShelveTestJSON-141035361 None] Deleting attachment 2be9bec9-4a3a-4128-b205-df90d9dc7406. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Flow 'volume_create_manager' (559e4f49-38d6-4a31-a570-8de23cb72d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b972ce3f-3a1b-40fe-b060-098421f1ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b972ce3f-3a1b-40fe-b060-098421f1ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1204137678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c527dbe4-1925-48f3-b956-1f75f49eb818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e2d1a7fae24850b208c59ea970870f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:45Z,use_quota=True,user_id='a05f5fdaa5384ef2b44196b04405ed2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5331ea33-9044-4974-b3d8-6ed7ec5b2716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5331ea33-9044-4974-b3d8-6ed7ec5b2716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3776c4bc-c234-4918-acb3-d7731a2c783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3776c4bc-c234-4918-acb3-d7731a2c783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c527dbe4-1925-48f3-b956-1f75f49eb818', 'volume_name': 'volume-c527dbe4-1925-48f3-b956-1f75f49eb818', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c67b93f-3c1a-4590-91c4-6ccc4b1daf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c67b93f-3c1a-4590-91c4-6ccc4b1daf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef2e569-07ee-4131-8b8e-6eefda53f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:45 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Volume c527dbe4-1925-48f3-b956-1f75f49eb818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c527dbe4-1925-48f3-b956-1f75f49eb818', 'volume_size': 1} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1204137678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c527dbe4-1925-48f3-b956-1f75f49eb818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e2d1a7fae24850b208c59ea970870f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:45Z,use_quota=True,user_id='a05f5fdaa5384ef2b44196b04405ed2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Creating volume c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:45 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:45 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 1073741824 Jul 22 20:39:45 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:45 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 1073741824" returned: 0 in 0.652s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:46 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 Jul 22 20:39:46 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:46 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818" returned: 0 in 0.346s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef2e569-07ee-4131-8b8e-6eefda53f12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c527dbe4-1925-48f3-b956-1f75f49eb818', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2935db-75d0-4aa2-958a-252744c1b893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:46 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Volume volume-c527dbe4-1925-48f3-b956-1f75f49eb818 (c527dbe4-1925-48f3-b956-1f75f49eb818): created successfully Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2935db-75d0-4aa2-958a-252744c1b893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Flow 'volume_create_manager' (559e4f49-38d6-4a31-a570-8de23cb72d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:46 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-16f4f0bb-5d6a-4806-bce9-ae66dd50d3ef tempest-VolumesDeleteCascade-925805719 None] Created volume successfully. Jul 22 20:39:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9885c98c-ce8e-4bd9-9793-47c916789359 tempest-GroupsV314Test-2081522020 None] Group tempest-GroupsV314Test-Group-1392043019: creating Jul 22 20:39:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9885c98c-ce8e-4bd9-9793-47c916789359 tempest-GroupsV314Test-2081522020 None] Group tempest-GroupsV314Test-Group-1392043019: created successfully Jul 22 20:39:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9885c98c-ce8e-4bd9-9793-47c916789359 tempest-GroupsV314Test-2081522020 None] Create group completed successfully. Jul 22 20:39:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Creating offline snapshot 3b164026-c57b-4606-9737-5364b1f9e982 of volume c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:39:47 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d30fc47-2d92-4133-9c3b-3b7922de5045]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:47 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 Jul 22 20:39:47 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:47 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818" returned: 0 in 0.422s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:48 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 1G Jul 22 20:39:48 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:48 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 1G" returned: 0 in 0.528s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:48 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 Jul 22 20:39:48 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:48 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982" returned: 0 in 0.349s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:48 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 is being set with open permissions: ugo+rw Jul 22 20:39:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:48 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 Jul 22 20:39:48 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:39:49 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Flow 'volume_create_manager' (190a2664-cfab-464c-8bb0-5c7f5a55e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf10a0e-fafe-43ab-b00c-fbafb7223cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982" returned: 0 in 0.480s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf10a0e-fafe-43ab-b00c-fbafb7223cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2103358047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93d96761-3e2c-4765-9758-faabe90ff2a8,host='devstack@QuobyteHD#QuobyteHD',id=050188be-27cc-4c91-87be-793cf1d327ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4029e778f149a38d479d2c540b45e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:49Z,use_quota=True,user_id='118dc36a0290477f9181fa5f73e559f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73af001f-c5c7-4650-a3f7-75ba12efb58f),volume_type_id=73af001f-c5c7-4650-a3f7-75ba12efb58f)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369664b7-c758-42d4-a7f8-224a3e773ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369664b7-c758-42d4-a7f8-224a3e773ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757f4085-dea8-4800-9a1d-2b5416676ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757f4085-dea8-4800-9a1d-2b5416676ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '050188be-27cc-4c91-87be-793cf1d327ab', 'volume_name': 'volume-050188be-27cc-4c91-87be-793cf1d327ab', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c6a4c9-cb25-4ff6-8d60-1599f99704e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c6a4c9-cb25-4ff6-8d60-1599f99704e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e760383-17d2-412f-9084-f52b8674bfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Volume 050188be-27cc-4c91-87be-793cf1d327ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-050188be-27cc-4c91-87be-793cf1d327ab', 'volume_size': 1} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:49 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.info Jul 22 20:39:49 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:49 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.info" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:49 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.info is being set with open permissions: ugo+rw Jul 22 20:39:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:49 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.info Jul 22 20:39:49 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:50 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.info" returned: 0 in 0.345s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93d96761-3e2c-4765-9758-faabe90ff2a8,created_at=2026-07-22T18:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2103358047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93d96761-3e2c-4765-9758-faabe90ff2a8,host='devstack@QuobyteHD#QuobyteHD',id=050188be-27cc-4c91-87be-793cf1d327ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4029e778f149a38d479d2c540b45e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:39:49Z,use_quota=True,user_id='118dc36a0290477f9181fa5f73e559f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73af001f-c5c7-4650-a3f7-75ba12efb58f),volume_type_id=73af001f-c5c7-4650-a3f7-75ba12efb58f)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Creating volume 050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:39:50 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-82e2f015-11f6-4483-9973-8e40d0e71d37 tempest-VolumesDeleteCascade-925805719 None] Create snapshot completed successfully Jul 22 20:39:50 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab 1073741824 Jul 22 20:39:50 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:50 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab 1073741824" returned: 0 in 0.605s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:51 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab Jul 22 20:39:51 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:51 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab" returned: 0 in 0.374s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.196s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e760383-17d2-412f-9084-f52b8674bfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-050188be-27cc-4c91-87be-793cf1d327ab', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91598939-76f6-4ff2-b043-c20f429662a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Creating offline snapshot 72ce7b02-da89-47b3-8e07-63e23d722abb of volume c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:39:51 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Volume volume-050188be-27cc-4c91-87be-793cf1d327ab (050188be-27cc-4c91-87be-793cf1d327ab): created successfully Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91598939-76f6-4ff2-b043-c20f429662a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Flow 'volume_create_manager' (190a2664-cfab-464c-8bb0-5c7f5a55e49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f509c93-cb50-4d77-a921-cc924b46bd09]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:51 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-45e9ac07-9b3b-42b9-a60f-905ba3d98c2f tempest-GroupsV314Test-2081522020 None] Created volume successfully. Jul 22 20:39:51 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 Jul 22 20:39:51 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:51 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982" returned: 0 in 0.561s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c527dbe4-1925-48f3-b956-1f75f49eb818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:39:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:52 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb 1G Jul 22 20:39:52 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:52 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb 1G" returned: 0 in 0.671s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:52 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb Jul 22 20:39:52 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:53 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb" returned: 0 in 0.459s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:53 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb is being set with open permissions: ugo+rw Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:53 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb Jul 22 20:39:53 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:53 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb" returned: 0 in 0.368s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.390s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:53 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Cloning volume 050188be-27cc-4c91-87be-793cf1d327ab to volume 2b5544f1-b8e9-469e-83e2-eda973a7f2ec Jul 22 20:39:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1de852a2-55b7-49b9-8358-ed63104f9254 tempest-VolumesDeleteCascade-925805719 None] Create snapshot completed successfully Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Creating offline snapshot 459c2f39-7740-49a3-9794-6165be441444 of volume 050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e101522d-c74f-4139-acec-d4a1e11222af]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:53 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab Jul 22 20:39:53 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:54 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab" returned: 0 in 0.425s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:54 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 1G Jul 22 20:39:54 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-c527dbe4-1925-48f3-b956-1f75f49eb818-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-c527dbe4-1925-48f3-b956-1f75f49eb818-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Performing cascade delete. {{(pid=87818) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-3b164026-c57b-4606-9737-5364b1f9e982-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-3b164026-c57b-4606-9737-5364b1f9e982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:54 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 1G" returned: 0 in 0.645s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050188be-27cc-4c91-87be-793cf1d327ab -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-3b164026-c57b-4606-9737-5364b1f9e982" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:54 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050188be-27cc-4c91-87be-793cf1d327ab -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 Jul 22 20:39:54 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-3b164026-c57b-4606-9737-5364b1f9e982" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Deleting offline snapshot 3b164026-c57b-4606-9737-5364b1f9e982 of volume c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] snapshot_file for this snap is: volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[68375fc7-6b37-46f7-b7f3-7f7efaab80ec]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:55 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 Jul 22 20:39:55 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:55 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050188be-27cc-4c91-87be-793cf1d327ab -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444" returned: 0 in 0.572s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:55 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:39:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:55 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 Jul 22 20:39:55 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:55 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982" returned: 0 in 0.817s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c527dbe4-1925-48f3-b956-1f75f49eb818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:39:55 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb7bccf-9e67-4d09-aabe-b0a8e98bb9fe]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:55 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444" returned: 0 in 0.626s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:55 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 Jul 22 20:39:55 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:56 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.info Jul 22 20:39:56 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:56 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.info" returned: 0 in 0.531s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:56 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:39:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:56 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.info Jul 22 20:39:56 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:56 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818" returned: 0 in 1.221s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:57 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.info" returned: 0 in 0.504s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Acquiring lock "cinder-quobyte-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dff8e1f-449c-489b-88c9-a45f3785059e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" acquired by "_copy_volume_from_snapshot" :: waited 0.093s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] snapshot: 459c2f39-7740-49a3-9794-6165be441444, volume: 2b5544f1-b8e9-469e-83e2-eda973a7f2ec, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71823d3-275d-42eb-ad82-24afc8e41a79]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:57 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb Jul 22 20:39:57 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:57 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 Jul 22 20:39:57 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:58 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb" returned: 0 in 1.319s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c527dbe4-1925-48f3-b956-1f75f49eb818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[21002c1b-d003-4a4a-9895-a6540dd92607]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:58 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444" returned: 0 in 1.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050188be-27cc-4c91-87be-793cf1d327ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:39:58 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 Jul 22 20:39:58 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8914f5d6-49c7-4e87-b04e-7f5fd95b00ff]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:59 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab Jul 22 20:39:59 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:59 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982" returned: 0 in 0.789s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c527dbe4-1925-48f3-b956-1f75f49eb818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:39:59 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c8d0a-1a48-4e81-9383-84b6e9f8db10]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:39:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:59 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 22 20:39:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab" returned: 0 in 0.724s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:39:59 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:39:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:39:59 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 Jul 22 20:39:59 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:39:59 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec Jul 22 20:39:59 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:00 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818" returned: 0 in 0.824s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:00 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 Jul 22 20:40:00 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:01 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982" returned: 0 in 1.187s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:01 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982 Jul 22 20:40:01 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:02 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.3b164026-c57b-4606-9737-5364b1f9e982" returned: 0 in 1.236s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb -F qcow2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:02 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb -F qcow2 Jul 22 20:40:02 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:04 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c527dbe4-1925-48f3-b956-1f75f49eb818 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb -F qcow2" returned: 0 in 1.827s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-3b164026-c57b-4606-9737-5364b1f9e982" released by "_delete_snapshot" :: held 9.731s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" released by "delete_snapshot" :: held 9.785s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:04 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Created reservations ['594fe616-36a9-4a2e-8530-ebac9457d0e5', '6f25d476-2821-4364-8afa-498c801044a4', '31a8b6fb-33e9-40d8-87b7-75ea70fb0015', '67a14ff4-3eee-4cb7-92a3-927460204489'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Delete snapshot completed successfully. Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-3b164026-c57b-4606-9737-5364b1f9e982-delete_snapshot" released by "delete_snapshot" :: held 10.416s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-72ce7b02-da89-47b3-8e07-63e23d722abb-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-72ce7b02-da89-47b3-8e07-63e23d722abb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-72ce7b02-da89-47b3-8e07-63e23d722abb" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-72ce7b02-da89-47b3-8e07-63e23d722abb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Deleting offline snapshot 72ce7b02-da89-47b3-8e07-63e23d722abb of volume c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] snapshot_file for this snap is: volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[74016b0f-f934-4115-8441-535e47821536]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:05 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb Jul 22 20:40:05 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:06 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb" returned: 0 in 1.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c527dbe4-1925-48f3-b956-1f75f49eb818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:40:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca793f6-a384-4bb1-be87-6a3ffd034b91]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:07 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 Jul 22 20:40:07 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:08 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818" returned: 0 in 1.916s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:08 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" returned: 0 in 9.343s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:08 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb Jul 22 20:40:08 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2623c-7843-49c4-8f76-a61d36a8720a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:09 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab Jul 22 20:40:09 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:09 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb" returned: 0 in 0.538s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:09 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb Jul 22 20:40:09 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:09 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab" returned: 0 in 0.736s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab, size 1024.00 MB, duration 9.35 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:40:09 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Converted 1024.00 MB image at 109.54 MB/s Jul 22 20:40:09 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:09 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec Jul 22 20:40:09 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:09 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818.72ce7b02-da89-47b3-8e07-63e23d722abb" returned: 0 in 0.379s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-72ce7b02-da89-47b3-8e07-63e23d722abb" released by "_delete_snapshot" :: held 4.529s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" released by "delete_snapshot" :: held 4.569s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:09 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Created reservations ['6ddd4d91-0fbf-492a-a5ad-0002ac977360', '2e6eec70-b3c2-4f21-9782-ea5d1c3384d5', 'aa9de864-ebc9-4488-a64d-a6de989b844c', '4ef3ed22-a52a-4de8-9610-c9b805df38be'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" returned: 0 in 0.306s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" released by "_copy_volume_from_snapshot" :: held 12.780s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Acquiring lock "cinder-quobyte-459c2f39-7740-49a3-9794-6165be441444" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-459c2f39-7740-49a3-9794-6165be441444" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Deleting offline snapshot 459c2f39-7740-49a3-9794-6165be441444 of volume 050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] snapshot_file for this snap is: volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:40:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Delete snapshot completed successfully. Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-72ce7b02-da89-47b3-8e07-63e23d722abb-delete_snapshot" released by "delete_snapshot" :: held 4.945s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Snapshots deleted, issuing volume delete {{(pid=87818) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e905bb-7ca9-4802-8226-53b1d14ff457]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" acquired by "delete_volume" :: waited 0.042s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529459a-cedb-4cff-be11-cc5a42ecae4f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:10 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 Jul 22 20:40:10 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:10 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 Jul 22 20:40:10 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:10 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:10 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818" returned: 0 in 0.459s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444" returned: 0 in 0.596s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050188be-27cc-4c91-87be-793cf1d327ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:40:10 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818 Jul 22 20:40:10 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e84d7e-3823-4316-bdf3-e09641fe29a0]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:10 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab Jul 22 20:40:10 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:11 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c527dbe4-1925-48f3-b956-1f75f49eb818" returned: 0 in 0.335s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-c527dbe4-1925-48f3-b956-1f75f49eb818" released by "delete_volume" :: held 0.908s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Created reservations ['a85bac62-aacf-4cfe-a816-93b98bc9d3a7', 'b2519234-fe30-4101-b3f0-075c5a73d907', '5deb2421-98f4-4c1b-acc0-af41f7c6c86a', 'f9a0c903-31b4-4502-b5a8-aedd9a9adb23'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:11 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab" returned: 0 in 0.460s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:11 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 Jul 22 20:40:11 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:11 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:11 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:11 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.429s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Deleted volume successfully. Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6b0e94c-d9cb-4a04-a28b-8acc99527443 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-c527dbe4-1925-48f3-b956-1f75f49eb818-delete_volume" released by "delete_volume" :: held 17.206s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:11 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444" returned: 0 in 0.635s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:11 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444 Jul 22 20:40:11 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:12 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab.459c2f39-7740-49a3-9794-6165be441444" returned: 0 in 0.296s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-459c2f39-7740-49a3-9794-6165be441444" released by "_delete_snapshot" :: held 2.154s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.670s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7cfe16f0-555f-4f21-abb2-30f14b3868ef tempest-GroupsV314Test-2081522020 None] Create group from source-group-93d96761-3e2c-4765-9758-faabe90ff2a8 completed successfully. Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Flow 'volume_create_manager' (d761e36a-c6e5-4737-92cc-708ea7746e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e7aca-ef48-452e-b8a6-655bcdb88747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e7aca-ef48-452e-b8a6-655bcdb88747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1199087488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feffbb38-7a85-46c9-a650-68525ce501c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e2d1a7fae24850b208c59ea970870f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:12Z,use_quota=True,user_id='a05f5fdaa5384ef2b44196b04405ed2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dd8f40-a889-44f2-ab35-5f95f3fe7c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dd8f40-a889-44f2-ab35-5f95f3fe7c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d261951-b741-4305-b3d3-ab48bd352321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d261951-b741-4305-b3d3-ab48bd352321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feffbb38-7a85-46c9-a650-68525ce501c0', 'volume_name': 'volume-feffbb38-7a85-46c9-a650-68525ce501c0', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43301a46-9a1a-4e30-9f86-93c2fb5de139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43301a46-9a1a-4e30-9f86-93c2fb5de139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aa4a70-0389-4ba1-b3d3-cbbe2af583f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Volume feffbb38-7a85-46c9-a650-68525ce501c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feffbb38-7a85-46c9-a650-68525ce501c0', 'volume_size': 1} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1199087488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feffbb38-7a85-46c9-a650-68525ce501c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e2d1a7fae24850b208c59ea970870f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:12Z,use_quota=True,user_id='a05f5fdaa5384ef2b44196b04405ed2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Creating volume feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:12 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:12 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 1073741824 Jul 22 20:40:12 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:12 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 1073741824" returned: 0 in 0.435s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:12 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 Jul 22 20:40:12 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Acquiring lock "cinder-quobyte-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb630d-d25a-46de-af70-ffb0e4cb28ab]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:13 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0" returned: 0 in 0.364s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aa4a70-0389-4ba1-b3d3-cbbe2af583f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feffbb38-7a85-46c9-a650-68525ce501c0', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b6aa72-eb92-4faa-b040-f578ec0e4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Volume volume-feffbb38-7a85-46c9-a650-68525ce501c0 (feffbb38-7a85-46c9-a650-68525ce501c0): created successfully Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b6aa72-eb92-4faa-b040-f578ec0e4708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Flow 'volume_create_manager' (d761e36a-c6e5-4737-92cc-708ea7746e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c58f1f55-67a4-497b-9e5f-5ecf1efaccf8 tempest-VolumesDeleteCascade-925805719 None] Created volume successfully. Jul 22 20:40:13 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec Jul 22 20:40:13 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:13 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" returned: 0 in 0.396s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:13 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec Jul 22 20:40:13 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:13 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-2b5544f1-b8e9-469e-83e2-eda973a7f2ec" released by "delete_volume" :: held 0.724s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Created reservations ['2521ebc6-f105-47b0-9000-821e23aeaf76'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:13 devstack cinder-volume[87818]: WARNING cinder.quota [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1288964810 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1288964810, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:40:13 devstack cinder-volume[87818]: WARNING cinder.quota [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1288964810 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1288964810, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:40:13 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Created reservations ['5cc8ef04-3b96-4e07-801b-e58d4cf6dd56', '080ba3b7-0901-4c35-b073-c49c0a11bc3c', '98fc2059-c9b6-4285-9031-1268c7fb1648', '218536ec-e68f-492d-a8f2-33e9988e74f0'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:14 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:14 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:14 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7b0f3c34-2a98-48ce-8510-fa21444c3f71 tempest-GroupsV314Test-2081522020 None] Delete group completed successfully. Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Creating offline snapshot 18f31bc5-cb65-499c-9f39-f5408cf7f482 of volume feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f897c5-fc1b-4fd1-8d07-2798e260b414]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Acquiring lock "cinder-quobyte-050188be-27cc-4c91-87be-793cf1d327ab" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-050188be-27cc-4c91-87be-793cf1d327ab" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f986a0-6333-4c01-a478-db8bfd87b296]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:14 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 Jul 22 20:40:14 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:14 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab Jul 22 20:40:14 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:15 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0" returned: 0 in 0.439s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:15 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 1G Jul 22 20:40:15 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:15 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab" returned: 0 in 0.419s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:15 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab Jul 22 20:40:15 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:15 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-050188be-27cc-4c91-87be-793cf1d327ab" returned: 0 in 0.266s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Lock "cinder-quobyte-050188be-27cc-4c91-87be-793cf1d327ab" released by "delete_volume" :: held 0.767s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:15 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 1G" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feffbb38-7a85-46c9-a650-68525ce501c0 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:15 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feffbb38-7a85-46c9-a650-68525ce501c0 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 Jul 22 20:40:15 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Created reservations ['0974269c-772f-4423-8475-655b8d2b3780'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Created reservations ['8b67e4ff-0445-4bb3-b626-4a6c4007a0ee', '2c1da0cb-fca1-41a1-a527-1e3b15aa8702', 'd0183f70-06ac-46fc-abc5-5e6241e324c3', 'c09d87b0-51ae-4947-bcbc-279bfe76bf02'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:15 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:15 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:15 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feffbb38-7a85-46c9-a650-68525ce501c0 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482" returned: 0 in 0.308s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:15 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 is being set with open permissions: ugo+rw Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:15 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 Jul 22 20:40:15 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:15 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.272s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:15 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f753aa46-d89c-484c-a6fa-f6a148699128 tempest-GroupsV314Test-2081522020 None] Delete group completed successfully. Jul 22 20:40:16 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:16 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.info Jul 22 20:40:16 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:16 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.info" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:16 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.info is being set with open permissions: ugo+rw Jul 22 20:40:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:16 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.info Jul 22 20:40:16 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:16 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.info" returned: 0 in 0.261s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7595d19a-488e-4c66-ac32-08d041c4f053 tempest-VolumesDeleteCascade-925805719 None] Create snapshot completed successfully Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Flow 'volume_create_manager' (008b6976-6962-4b0b-9d3b-441b3663579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9751893-bb43-4eaf-8b77-db46d0c4de89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9751893-bb43-4eaf-8b77-db46d0c4de89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1617485350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1533b0b-5350-4f79-b724-b28209fddfe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e2d1a7fae24850b208c59ea970870f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18f31bc5-cb65-499c-9f39-f5408cf7f482,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:18Z,use_quota=True,user_id='a05f5fdaa5384ef2b44196b04405ed2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8edc0f1-d26f-4cc2-878d-128e2dc57e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8edc0f1-d26f-4cc2-878d-128e2dc57e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2549af-8268-4827-9bb8-c4338111bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2549af-8268-4827-9bb8-c4338111bedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1533b0b-5350-4f79-b724-b28209fddfe5', 'volume_name': 'volume-f1533b0b-5350-4f79-b724-b28209fddfe5', 'volume_size': 1, 'snapshot_id': '18f31bc5-cb65-499c-9f39-f5408cf7f482'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280dcc96-54ad-4703-88e9-2a1c09cb2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280dcc96-54ad-4703-88e9-2a1c09cb2208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0feffa6-7ca0-41ee-b07e-48f1189f49e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:18 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Volume f1533b0b-5350-4f79-b724-b28209fddfe5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1533b0b-5350-4f79-b724-b28209fddfe5', 'volume_size': 1, 'snapshot_id': '18f31bc5-cb65-499c-9f39-f5408cf7f482'} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-18f31bc5-cb65-499c-9f39-f5408cf7f482-f1533b0b-5350-4f79-b724-b28209fddfe5" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-18f31bc5-cb65-499c-9f39-f5408cf7f482-f1533b0b-5350-4f79-b724-b28209fddfe5" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Creating volume f1533b0b-5350-4f79-b724-b28209fddfe5 from snapshot 18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-f1533b0b-5350-4f79-b724-b28209fddfe5" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-f1533b0b-5350-4f79-b724-b28209fddfe5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] snapshot: 18f31bc5-cb65-499c-9f39-f5408cf7f482, volume: f1533b0b-5350-4f79-b724-b28209fddfe5, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a48abd-a50d-4558-998f-df842b7c468e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:18 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 Jul 22 20:40:18 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:19 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482" returned: 0 in 0.410s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feffbb38-7a85-46c9-a650-68525ce501c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d19b34-d91e-45af-aee6-1d0ca95cce89]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:19 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 Jul 22 20:40:19 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:19 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0" returned: 0 in 0.421s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:40:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:19 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 Jul 22 20:40:19 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:22 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=110,cinder:SELECT=87,cinder:DELETE=6,cinder:INSERT=37 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:40:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-606e249e-1d32-445d-9c23-f8795b6a4c76 tempest-GroupsV320Test-586924791 None] Group tempest-GroupsV320Test-Group-837265676: creating Jul 22 20:40:22 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=108,cinder:UPDATE=104,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:40:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-606e249e-1d32-445d-9c23-f8795b6a4c76 tempest-GroupsV320Test-586924791 None] Group tempest-GroupsV320Test-Group-837265676: created successfully Jul 22 20:40:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-606e249e-1d32-445d-9c23-f8795b6a4c76 tempest-GroupsV320Test-586924791 None] Create group completed successfully. Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Created reservations ['bea4639a-9514-4b4c-aacf-69fd9636bbca'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:24 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:24 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:24 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5" returned: 0 in 5.321s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[897f3aa6-f058-405e-a144-2d52ea9f9d4a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:24 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.349s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:24 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f42efe00-72cf-40a3-b5e9-defde4e6b8e0 tempest-GroupsV320Test-586924791 None] Delete group completed successfully. Jul 22 20:40:25 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 Jul 22 20:40:25 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Flow 'volume_create_manager' (5305bc63-c34d-48c6-801c-86d027365161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8c055c-8ad6-4eca-9a8e-eedfc198b5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:25 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8c055c-8ad6-4eca-9a8e-eedfc198b5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1961283797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc61d270-6ebc-4f79-b295-8b59a58cbc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f96e16e56405aab9aad521a8c8ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:25Z,use_quota=True,user_id='b0efe511cdd6479e98606c930ebc17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148622fc-d656-4784-b62a-0f3085005be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148622fc-d656-4784-b62a-0f3085005be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7149504c-cd70-41d8-9d03-dd5e0839b4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7149504c-cd70-41d8-9d03-dd5e0839b4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc61d270-6ebc-4f79-b295-8b59a58cbc83', 'volume_name': 'volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22535d14-bd5c-4f08-b754-ba38051e5e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22535d14-bd5c-4f08-b754-ba38051e5e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218550a4-3c81-4118-80fa-65c4eec91892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Volume dc61d270-6ebc-4f79-b295-8b59a58cbc83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83', 'volume_size': 1} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0" returned: 0 in 0.613s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:40:25 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Converted 1024.00 MB image at 192.40 MB/s Jul 22 20:40:25 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 is being set with open permissions: ugo+rw Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:25 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 Jul 22 20:40:25 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:25 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5" returned: 0 in 0.247s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-f1533b0b-5350-4f79-b724-b28209fddfe5" released by "_copy_volume_from_snapshot" :: held 7.133s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-18f31bc5-cb65-499c-9f39-f5408cf7f482-f1533b0b-5350-4f79-b724-b28209fddfe5" released by "_create_volume_from_snapshot" :: held 7.171s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.188s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.277s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1961283797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc61d270-6ebc-4f79-b295-8b59a58cbc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f96e16e56405aab9aad521a8c8ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:25Z,use_quota=True,user_id='b0efe511cdd6479e98606c930ebc17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Creating volume dc61d270-6ebc-4f79-b295-8b59a58cbc83 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:25 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:25 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 1073741824 Jul 22 20:40:25 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0feffa6-7ca0-41ee-b07e-48f1189f49e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1533b0b-5350-4f79-b724-b28209fddfe5', 'volume_size': 1, 'snapshot_id': '18f31bc5-cb65-499c-9f39-f5408cf7f482'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cdc6da-b891-4475-acc5-cc6150a0f9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Volume volume-f1533b0b-5350-4f79-b724-b28209fddfe5 (f1533b0b-5350-4f79-b724-b28209fddfe5): created successfully Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cdc6da-b891-4475-acc5-cc6150a0f9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Flow 'volume_create_manager' (008b6976-6962-4b0b-9d3b-441b3663579a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3c2a3ae7-12df-4d58-a7c7-fea6d64dab97 tempest-VolumesDeleteCascade-925805719 None] Created volume successfully. Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-feffbb38-7a85-46c9-a650-68525ce501c0-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-feffbb38-7a85-46c9-a650-68525ce501c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Performing cascade delete. {{(pid=87818) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-18f31bc5-cb65-499c-9f39-f5408cf7f482-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-18f31bc5-cb65-499c-9f39-f5408cf7f482-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-feffbb38-7a85-46c9-a650-68525ce501c0" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:26 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 1073741824" returned: 0 in 0.569s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-feffbb38-7a85-46c9-a650-68525ce501c0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-18f31bc5-cb65-499c-9f39-f5408cf7f482" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-18f31bc5-cb65-499c-9f39-f5408cf7f482" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Deleting offline snapshot 18f31bc5-cb65-499c-9f39-f5408cf7f482 of volume feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] snapshot_file for this snap is: volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c2381a-78c8-4c35-a052-0dc6256f8dcb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:26 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 Jul 22 20:40:26 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:26 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 Jul 22 20:40:26 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:26 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83" returned: 0 in 0.256s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218550a4-3c81-4118-80fa-65c4eec91892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd663698-1c87-48c2-a3c2-300001c40526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:26 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Volume volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 (dc61d270-6ebc-4f79-b295-8b59a58cbc83): created successfully Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd663698-1c87-48c2-a3c2-300001c40526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Flow 'volume_create_manager' (5305bc63-c34d-48c6-801c-86d027365161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9af39e33-1477-4051-ade2-d54e790c1e47 tempest-AttachVolumeTestJSON-1175768797 None] Created volume successfully. Jul 22 20:40:26 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482" returned: 0 in 0.404s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feffbb38-7a85-46c9-a650-68525ce501c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fa1e95-15f2-4935-ad8a-ae5a0c6ec430]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:26 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 Jul 22 20:40:26 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:27 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0" returned: 0 in 0.372s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:27 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 Jul 22 20:40:27 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:27 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482" returned: 0 in 0.390s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:27 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482 Jul 22 20:40:27 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:27 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0.18f31bc5-cb65-499c-9f39-f5408cf7f482" returned: 0 in 0.319s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-18f31bc5-cb65-499c-9f39-f5408cf7f482" released by "_delete_snapshot" :: held 1.626s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-feffbb38-7a85-46c9-a650-68525ce501c0" released by "delete_snapshot" :: held 1.660s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Created reservations ['574d1b27-4c9e-4fbb-b936-03c1f9e37bdc', 'b6df7293-7ff4-4fcf-833e-738c617b36b5', '2f3ae2bc-c09f-4431-b664-808a0826c65c', '03d3f0ad-6e8e-4f3f-9130-afbf23d95f1c'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Delete snapshot completed successfully. Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-18f31bc5-cb65-499c-9f39-f5408cf7f482-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Snapshots deleted, issuing volume delete {{(pid=87818) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-feffbb38-7a85-46c9-a650-68525ce501c0" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-feffbb38-7a85-46c9-a650-68525ce501c0" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2867bf-8147-46c9-bd4f-54236cf24411]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-efe5bd42-6bf4-40ab-a2e3-01db2997cecc req-afdbd41f-b723-44c3-8f9b-53410560e9b1 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-efe5bd42-6bf4-40ab-a2e3-01db2997cecc req-afdbd41f-b723-44c3-8f9b-53410560e9b1 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-efe5bd42-6bf4-40ab-a2e3-01db2997cecc req-afdbd41f-b723-44c3-8f9b-53410560e9b1 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-efe5bd42-6bf4-40ab-a2e3-01db2997cecc req-afdbd41f-b723-44c3-8f9b-53410560e9b1 tempest-AttachVolumeTestJSON-1175768797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'deb80bd0-79e2-4854-8ecd-6ccf49adf8ff', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:40:28 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 Jul 22 20:40:28 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-efe5bd42-6bf4-40ab-a2e3-01db2997cecc req-afdbd41f-b723-44c3-8f9b-53410560e9b1 tempest-AttachVolumeTestJSON-1175768797 None] attachment_update completed successfully. Jul 22 20:40:28 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0" returned: 0 in 0.438s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:28 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0 Jul 22 20:40:28 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:28 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-feffbb38-7a85-46c9-a650-68525ce501c0" returned: 0 in 0.291s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-feffbb38-7a85-46c9-a650-68525ce501c0" released by "delete_volume" :: held 0.825s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Created reservations ['44a57155-d6a2-48e9-9e4c-f437ac89e2ed', 'c4d5d5d7-3a27-431e-9857-732ba75a66a3', '955d44e5-595b-42fd-946a-179c67a72cc6', '7c820298-9be7-4c6d-a54c-ea0e5984cb60'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:29 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:29 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:29 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.303s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:29 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Deleted volume successfully. Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b031d691-dbca-4629-8e73-48cdb896e7fb tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-feffbb38-7a85-46c9-a650-68525ce501c0-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-f1533b0b-5350-4f79-b724-b28209fddfe5-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-f1533b0b-5350-4f79-b724-b28209fddfe5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "cinder-quobyte-f1533b0b-5350-4f79-b724-b28209fddfe5" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-f1533b0b-5350-4f79-b724-b28209fddfe5" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f73d1-383c-4b28-9b48-64386dd6931d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:29 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 Jul 22 20:40:29 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:30 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5" returned: 0 in 0.359s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:30 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5 Jul 22 20:40:30 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:30 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f1533b0b-5350-4f79-b724-b28209fddfe5" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-quobyte-f1533b0b-5350-4f79-b724-b28209fddfe5" released by "delete_volume" :: held 0.681s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Created reservations ['c5e05f5e-b3f1-4ce9-a5d9-ef9fad2e7ef4', 'd0e4c596-9304-4a98-8f70-000737d4fa68', '9f268798-7de5-4af6-8c8a-518128b7cf2c', '05e7607e-7c04-4a8a-8375-1aaf27e3673b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:30 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:30 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:30 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.305s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Deleted volume successfully. Jul 22 20:40:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bbc502a6-f789-424b-82cd-c4c73f2699ae tempest-VolumesDeleteCascade-925805719 None] Lock "cinder-f1533b0b-5350-4f79-b724-b28209fddfe5-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Flow 'volume_create_manager' (60f540bd-0353-4ecf-b104-5117a73fc03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8bcd3e-5e0d-4be0-8473-b435aac48fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8bcd3e-5e0d-4be0-8473-b435aac48fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1257060748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f96e16e56405aab9aad521a8c8ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:31Z,use_quota=True,user_id='b0efe511cdd6479e98606c930ebc17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc51528b-c7bf-48c8-9a73-faa9a3e47c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc51528b-c7bf-48c8-9a73-faa9a3e47c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3cd494c-a6c3-4b87-905a-a770bc93e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3cd494c-a6c3-4b87-905a-a770bc93e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4', 'volume_name': 'volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3d698-87be-4a02-8428-1c4e97243db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3d698-87be-4a02-8428-1c4e97243db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824f9f51-9a29-43fe-aafa-24f8273a527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:31 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Volume fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4', 'volume_size': 1} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1257060748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f96e16e56405aab9aad521a8c8ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:31Z,use_quota=True,user_id='b0efe511cdd6479e98606c930ebc17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Creating volume fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:31 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:31 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 1073741824 Jul 22 20:40:31 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:31 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 1073741824" returned: 0 in 0.528s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:31 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 Jul 22 20:40:31 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:32 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4" returned: 0 in 0.331s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824f9f51-9a29-43fe-aafa-24f8273a527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80735ab5-a725-4811-9664-c53b8791f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:32 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Volume volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 (fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4): created successfully Jul 22 20:40:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80735ab5-a725-4811-9664-c53b8791f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Flow 'volume_create_manager' (60f540bd-0353-4ecf-b104-5117a73fc03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-270835a8-5abe-4fd8-aad8-ccb727fb39d0 tempest-AttachVolumeTestJSON-1175768797 None] Created volume successfully. Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-bf499841-6a06-4677-8a3b-aa052a4b3478 req-de38c29f-782d-436d-a75a-bc75e89010ac tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-bf499841-6a06-4677-8a3b-aa052a4b3478 req-de38c29f-782d-436d-a75a-bc75e89010ac tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-bf499841-6a06-4677-8a3b-aa052a4b3478 req-de38c29f-782d-436d-a75a-bc75e89010ac tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-bf499841-6a06-4677-8a3b-aa052a4b3478 req-de38c29f-782d-436d-a75a-bc75e89010ac tempest-AttachVolumeTestJSON-1175768797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '735cfc8f-ca52-4ba9-b22d-2d58eec150bf', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:40:34 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-bf499841-6a06-4677-8a3b-aa052a4b3478 req-de38c29f-782d-436d-a75a-bc75e89010ac tempest-AttachVolumeTestJSON-1175768797 None] attachment_update completed successfully. Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Flow 'volume_create_manager' (972402e1-6c51-45e1-b5f2-f2b97cdb0232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7de012b-6084-4fc9-a7a1-a6659e5a53e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7de012b-6084-4fc9-a7a1-a6659e5a53e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-673946713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab9779d56a2492f9bdc9a371dbca9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:35Z,use_quota=True,user_id='c71c027e17ab4565836f696523a1cb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d05fd5-8238-4613-88ee-69f7711711f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d05fd5-8238-4613-88ee-69f7711711f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d3f959-7851-43f1-af4e-0142962f93d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d3f959-7851-43f1-af4e-0142962f93d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8', 'volume_name': 'volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef8fba-9397-4a6a-be9d-a2c7e27ed288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef8fba-9397-4a6a-be9d-a2c7e27ed288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9f0659-6688-42f9-b1ce-da692d294454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:34 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Volume 7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8', 'volume_size': 1} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-673946713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab9779d56a2492f9bdc9a371dbca9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:35Z,use_quota=True,user_id='c71c027e17ab4565836f696523a1cb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Creating volume 7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:34 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:34 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 1073741824 Jul 22 20:40:34 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:35 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 1073741824" returned: 0 in 0.596s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:35 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 Jul 22 20:40:35 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:35 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8" returned: 0 in 0.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9f0659-6688-42f9-b1ce-da692d294454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d66d17-b863-487c-bcba-323e89ea70aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:35 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Volume volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 (7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8): created successfully Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d66d17-b863-487c-bcba-323e89ea70aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Flow 'volume_create_manager' (972402e1-6c51-45e1-b5f2-f2b97cdb0232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-957f13a4-f2d1-4936-ba36-22f6b49c2d2c tempest-VolumesMetadataTest-1667521595 None] Created volume successfully. Jul 22 20:40:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-a2d69dcc-8189-4c20-b2cb-e7dd4317bf11 req-23a2de0e-78b4-4928-a607-30e45ecc7661 tempest-AttachVolumeTestJSON-1175768797 None] Terminate volume connection completed successfully. Jul 22 20:40:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-a2d69dcc-8189-4c20-b2cb-e7dd4317bf11 req-23a2de0e-78b4-4928-a607-30e45ecc7661 tempest-AttachVolumeTestJSON-1175768797 None] Deleting attachment deb80bd0-79e2-4854-8ecd-6ccf49adf8ff. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:40:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-f5d43c25-b1d8-4e1d-b561-d7c1b291958f req-2f539d97-1513-4eae-8938-3e8463ef01e2 tempest-AttachVolumeTestJSON-1175768797 None] Terminate volume connection completed successfully. Jul 22 20:40:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-f5d43c25-b1d8-4e1d-b561-d7c1b291958f req-2f539d97-1513-4eae-8938-3e8463ef01e2 tempest-AttachVolumeTestJSON-1175768797 None] Deleting attachment 735cfc8f-ca52-4ba9-b22d-2d58eec150bf. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Acquiring lock "cinder-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Lock "cinder-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Acquiring lock "cinder-quobyte-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Lock "cinder-quobyte-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcdef14-ee39-4d14-a215-08c81d7fd4ef]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:38 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 Jul 22 20:40:38 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:38 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8" returned: 0 in 0.592s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:38 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8 Jul 22 20:40:38 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:39 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8" returned: 0 in 0.416s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Lock "cinder-quobyte-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8" released by "delete_volume" :: held 1.141s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Created reservations ['435485db-13c6-483e-ac5c-461a8b057d70', 'd1ce694d-882a-46e5-8528-12355d8bbe10', '9c60398f-a088-4e8e-b0f9-301cc592f6fb', '2acc8bbe-efad-4e1d-b807-a345ccf87794'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:39 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:39 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:40 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.665s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:40 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:40 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Deleted volume successfully. Jul 22 20:40:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7b8c255b-dc16-4f56-9b9c-fff7249ce7f8 tempest-VolumesMetadataTest-1667521595 None] Lock "cinder-7e9b4c15-fd18-45a2-aee1-2ba9ee4224f8-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:41 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:41 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:41 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.356s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Flow 'volume_create_manager' (34a8ad57-cc60-4881-98d1-469f4a839601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60bad4e-4859-4df8-8e04-d3be90989462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60bad4e-4859-4df8-8e04-d3be90989462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1428336875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c579916-e22e-4e89-a23d-1a08266ce142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7d4e44d88e470e8250330985159fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:42Z,use_quota=True,user_id='962c0d1bb09d483ca315c5d342222b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed40c4f3-1d03-4acd-8ee2-e7ed25d17532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed40c4f3-1d03-4acd-8ee2-e7ed25d17532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b0b7af-93d2-4e22-a3f0-452c01ee6c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b0b7af-93d2-4e22-a3f0-452c01ee6c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c579916-e22e-4e89-a23d-1a08266ce142', 'volume_name': 'volume-7c579916-e22e-4e89-a23d-1a08266ce142', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2816ecfb-b1ac-4efd-ab06-3efb4aa996e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2816ecfb-b1ac-4efd-ab06-3efb4aa996e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bcfaea-1d24-4854-97ac-5430e423ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Volume 7c579916-e22e-4e89-a23d-1a08266ce142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c579916-e22e-4e89-a23d-1a08266ce142', 'volume_size': 1} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1428336875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c579916-e22e-4e89-a23d-1a08266ce142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7d4e44d88e470e8250330985159fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:42Z,use_quota=True,user_id='962c0d1bb09d483ca315c5d342222b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Creating volume 7c579916-e22e-4e89-a23d-1a08266ce142 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:42 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:42 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 1073741824 Jul 22 20:40:42 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Acquiring lock "cinder-2cb73551-ecd1-4cd8-aad5-885c06277d3a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "cinder-2cb73551-ecd1-4cd8-aad5-885c06277d3a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:42 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 1073741824" returned: 0 in 0.559s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Acquiring lock "cinder-quobyte-2cb73551-ecd1-4cd8-aad5-885c06277d3a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "cinder-quobyte-2cb73551-ecd1-4cd8-aad5-885c06277d3a" acquired by "delete_volume" :: waited 0.047s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:42 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 Jul 22 20:40:42 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfe7f1e-5fcf-4f51-bfed-302e70093bf3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:42 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a Jul 22 20:40:42 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:43 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142" returned: 0 in 0.380s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bcfaea-1d24-4854-97ac-5430e423ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c579916-e22e-4e89-a23d-1a08266ce142', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343c18d-e670-4ed4-af47-b29f9a13a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:43 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Volume volume-7c579916-e22e-4e89-a23d-1a08266ce142 (7c579916-e22e-4e89-a23d-1a08266ce142): created successfully Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343c18d-e670-4ed4-af47-b29f9a13a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Flow 'volume_create_manager' (34a8ad57-cc60-4881-98d1-469f4a839601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:43 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-750a8af2-8d40-4b2e-b66a-558bd11e93b4 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Created volume successfully. Jul 22 20:40:43 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a" returned: 0 in 0.454s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:43 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a Jul 22 20:40:43 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "cinder-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "cinder-quobyte-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-quobyte-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[221aeac8-d0be-4c7f-993c-320e23d759b3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:43 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2cb73551-ecd1-4cd8-aad5-885c06277d3a" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "cinder-quobyte-2cb73551-ecd1-4cd8-aad5-885c06277d3a" released by "delete_volume" :: held 0.791s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:43 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 Jul 22 20:40:43 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Created reservations ['6ac7597e-7dce-4694-bbd8-ebe6d2155978', 'd47e09c2-94be-4da9-9c3b-2e5c0e7a8fd1', '625a1865-95ab-4336-be5e-2ba2b4a0a925', 'df1ce4df-6a4c-4ed2-b11d-37f69a00e038'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:43 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:43 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:43 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4" returned: 0 in 0.459s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:43 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4 Jul 22 20:40:43 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:44 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Deleted volume successfully. Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8652ce51-6e18-4e60-a3dc-133e7b53c7fd tempest-AttachVolumeShelveTestJSON-141035361 None] Lock "cinder-2cb73551-ecd1-4cd8-aad5-885c06277d3a-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Acquiring lock "cinder-7c579916-e22e-4e89-a23d-1a08266ce142-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "cinder-7c579916-e22e-4e89-a23d-1a08266ce142-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Acquiring lock "cinder-quobyte-7c579916-e22e-4e89-a23d-1a08266ce142" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "cinder-quobyte-7c579916-e22e-4e89-a23d-1a08266ce142" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0848ec-ac20-4f49-9ad9-6ae490ac4647]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:44 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4" returned: 0 in 0.345s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-quobyte-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4" released by "delete_volume" :: held 0.851s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Created reservations ['da99a004-d9ad-4dea-8414-fab0081367c5', '2871de50-a817-4015-9dfa-6e71436f2f65', '0d75dd39-3f72-4930-8a9b-d893be247e24', 'fd18b311-b455-4f7d-8f42-e621973b013f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:44 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 Jul 22 20:40:44 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:44 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:44 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "cinder-dc61d270-6ebc-4f79-b295-8b59a58cbc83-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-dc61d270-6ebc-4f79-b295-8b59a58cbc83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "cinder-quobyte-dc61d270-6ebc-4f79-b295-8b59a58cbc83" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-quobyte-dc61d270-6ebc-4f79-b295-8b59a58cbc83" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7453c2-ffc1-43e6-9170-2fd22fe998cb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:44 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.397s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:44 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142" returned: 0 in 0.632s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Deleted volume successfully. Jul 22 20:40:44 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 Jul 22 20:40:44 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:44 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142 Jul 22 20:40:44 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-12aed894-dd88-40e5-9ddb-35c766256eb6 tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-fc2f5e00-bf64-4ca0-8aa1-f15cb1a1b3a4-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:45 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83" returned: 0 in 0.506s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:45 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83 Jul 22 20:40:45 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:45 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7c579916-e22e-4e89-a23d-1a08266ce142" returned: 0 in 0.428s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "cinder-quobyte-7c579916-e22e-4e89-a23d-1a08266ce142" released by "delete_volume" :: held 1.112s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Created reservations ['8371236a-4087-4d78-9785-d9d469f0b55b', '316925e7-c205-4df1-8bf3-5b726cf0d36c', 'e7bb0b65-1c20-471b-97d7-79f0dabc3ec3', 'aa10d518-3220-472c-baa2-c02ea7b9d1d4'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:45 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:45 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:45 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc61d270-6ebc-4f79-b295-8b59a58cbc83" returned: 0 in 0.302s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-quobyte-dc61d270-6ebc-4f79-b295-8b59a58cbc83" released by "delete_volume" :: held 0.876s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Created reservations ['923531f4-57f7-4d28-ab61-6f7ebd4eb8c9', 'fa75cd3c-043e-46ad-9f2d-04c44aab15ec', 'd7ff0f7b-8a94-4b7f-90fa-e71c8ddc09f2', '5f7020d1-981d-4134-ab0b-239b402255df'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:45 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:45 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:45 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.334s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Deleted volume successfully. Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6eed4da6-7eef-4efd-a846-3d750975bd48 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "cinder-7c579916-e22e-4e89-a23d-1a08266ce142-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "cinder-39f13ae9-3fda-4758-98f4-4fed7045dfdb-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-39f13ae9-3fda-4758-98f4-4fed7045dfdb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:46 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "cinder-quobyte-39f13ae9-3fda-4758-98f4-4fed7045dfdb" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.360s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:46 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Deleted volume successfully. Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-quobyte-39f13ae9-3fda-4758-98f4-4fed7045dfdb" acquired by "delete_volume" :: waited 0.032s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1a848180-c419-46bc-a25d-2e2b81e105eb tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-dc61d270-6ebc-4f79-b295-8b59a58cbc83-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e875ce0e-6cd0-428f-9e02-2282d48216e8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:46 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb Jul 22 20:40:46 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:46 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb" returned: 0 in 0.418s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:46 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb Jul 22 20:40:46 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:46 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-39f13ae9-3fda-4758-98f4-4fed7045dfdb" returned: 0 in 0.389s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-quobyte-39f13ae9-3fda-4758-98f4-4fed7045dfdb" released by "delete_volume" :: held 0.852s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:46 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Created reservations ['4cf28e0a-dc1b-428c-8ab0-fb49088fe36c', '16d001c2-9fbb-4fe2-ad08-60fc742e7397', '92d40d5c-f10e-4d55-9e56-7f241ae5fb69', '146c090f-de9d-4c2b-a6dd-1bc88ceec63b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:47 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:47 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Flow 'volume_create_manager' (1d113d97-f7ba-4cf4-bb71-051ad5f15a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b86b1e9-69f7-48cc-84f0-4063560923c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Flow 'volume_create_manager' (430a0305-6365-4239-ac51-e00bd5a19c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b09d6-385f-4c56-920f-b73eb7d2d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b86b1e9-69f7-48cc-84f0-4063560923c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2082333791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e40a01-5987-48b1-bc22-2825df248aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00aed1e120e47dfa0cd0a280539bbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:47Z,use_quota=True,user_id='725acfe623af48d889c2239e0a99077e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bf18c6-51df-47c3-b27c-31e9abb0843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bf18c6-51df-47c3-b27c-31e9abb0843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7ec7a1-4e5d-420c-a3c7-00e35e9384c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7ec7a1-4e5d-420c-a3c7-00e35e9384c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e40a01-5987-48b1-bc22-2825df248aaf', 'volume_name': 'volume-83e40a01-5987-48b1-bc22-2825df248aaf', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cccc666-e1ae-4f23-b153-0f8a2e9ee71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cccc666-e1ae-4f23-b153-0f8a2e9ee71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7ef296-136b-4bcc-aca4-dc79dbd3c2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Volume 83e40a01-5987-48b1-bc22-2825df248aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e40a01-5987-48b1-bc22-2825df248aaf', 'volume_size': 1} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2082333791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e40a01-5987-48b1-bc22-2825df248aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00aed1e120e47dfa0cd0a280539bbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:47Z,use_quota=True,user_id='725acfe623af48d889c2239e0a99077e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Creating volume 83e40a01-5987-48b1-bc22-2825df248aaf {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:47 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b09d6-385f-4c56-920f-b73eb7d2d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075297204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e233bb4-21ea-4e4b-b84f-6f048d0487df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7d4e44d88e470e8250330985159fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:47Z,use_quota=True,user_id='962c0d1bb09d483ca315c5d342222b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:47 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf 1073741824 Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852966f4-ab6a-484d-a4d6-15138406d65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852966f4-ab6a-484d-a4d6-15138406d65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99899e91-1122-4aea-9b1c-89a08a99e556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99899e91-1122-4aea-9b1c-89a08a99e556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e233bb4-21ea-4e4b-b84f-6f048d0487df', 'volume_name': 'volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82452e0-9020-405f-9385-fe9fb6bfd7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82452e0-9020-405f-9385-fe9fb6bfd7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7baa3a79-0389-4712-96b4-a2cf129dd833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:47 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Volume 8e233bb4-21ea-4e4b-b84f-6f048d0487df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df', 'volume_size': 1} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.384s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Deleted volume successfully. Jul 22 20:40:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dfed2350-140b-452b-812d-0953180c339c tempest-AttachVolumeTestJSON-1175768797 None] Lock "cinder-39f13ae9-3fda-4758-98f4-4fed7045dfdb-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:48 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf 1073741824" returned: 0 in 0.583s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:48 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf Jul 22 20:40:48 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:48 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf" returned: 0 in 0.295s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.837s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075297204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e233bb4-21ea-4e4b-b84f-6f048d0487df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7d4e44d88e470e8250330985159fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:47Z,use_quota=True,user_id='962c0d1bb09d483ca315c5d342222b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Creating volume 8e233bb4-21ea-4e4b-b84f-6f048d0487df {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:48 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7ef296-136b-4bcc-aca4-dc79dbd3c2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e40a01-5987-48b1-bc22-2825df248aaf', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6b55b2-2d5e-4f65-8a74-a70e8d7f5cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:48 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df 1073741824 Jul 22 20:40:48 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:48 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Volume volume-83e40a01-5987-48b1-bc22-2825df248aaf (83e40a01-5987-48b1-bc22-2825df248aaf): created successfully Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6b55b2-2d5e-4f65-8a74-a70e8d7f5cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Flow 'volume_create_manager' (1d113d97-f7ba-4cf4-bb71-051ad5f15a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:48 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1541b001-8843-4477-bceb-b323ceb3b7e4 tempest-VolumesTransfersV357Test-817646704 None] Created volume successfully. Jul 22 20:40:49 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df 1073741824" returned: 0 in 0.618s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:49 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df Jul 22 20:40:49 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:49 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df" returned: 0 in 0.351s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7baa3a79-0389-4712-96b4-a2cf129dd833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9571031-4e0b-4387-ade7-975a99772731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Volume volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df (8e233bb4-21ea-4e4b-b84f-6f048d0487df): created successfully Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9571031-4e0b-4387-ade7-975a99772731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Flow 'volume_create_manager' (430a0305-6365-4239-ac51-e00bd5a19c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-839c4566-8577-4675-a9ee-eaa198620277 tempest-VolumeQuotasAdminTestJSON-1528886005 None] Created volume successfully. Jul 22 20:40:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f6b4c996-bac4-41c8-9950-d506aa9fd19f tempest-VolumesTransfersV357Test-68907081 None] Transfer volume completed successfully. Jul 22 20:40:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Acquiring lock "cinder-83e40a01-5987-48b1-bc22-2825df248aaf-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-83e40a01-5987-48b1-bc22-2825df248aaf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Acquiring lock "cinder-quobyte-83e40a01-5987-48b1-bc22-2825df248aaf" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-quobyte-83e40a01-5987-48b1-bc22-2825df248aaf" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aff139-bd89-4ca2-ac39-360a4bde5404]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:51 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf Jul 22 20:40:51 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:51 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bf2d4a1e-4c57-4acc-9ec4-cbf3f17312bb tempest-VolumeQuotasAdminTestJSON-1203741124 None] Transfer volume completed successfully. Jul 22 20:40:51 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf" returned: 0 in 0.558s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:51 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf Jul 22 20:40:51 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:51 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Acquiring lock "cinder-8e233bb4-21ea-4e4b-b84f-6f048d0487df-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-83e40a01-5987-48b1-bc22-2825df248aaf" returned: 0 in 0.341s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Lock "cinder-8e233bb4-21ea-4e4b-b84f-6f048d0487df-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-quobyte-83e40a01-5987-48b1-bc22-2825df248aaf" released by "delete_volume" :: held 0.978s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Acquiring lock "cinder-quobyte-8e233bb4-21ea-4e4b-b84f-6f048d0487df" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Lock "cinder-quobyte-8e233bb4-21ea-4e4b-b84f-6f048d0487df" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34481ff-6328-40b7-84b8-5d2d31b374b1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Created reservations ['5447936f-fd6d-4f7d-8524-7bdd80a76d78', '26e8a5c9-de08-4684-8279-8978487c3775', 'aca4f885-acec-491b-8175-90f71faa9e61', 'aebfdc76-f9b3-48cd-90f9-c862429d6248'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:52 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df Jul 22 20:40:52 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:52 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:52 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:52 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:52 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df" returned: 0 in 0.517s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.359s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Deleted volume successfully. Jul 22 20:40:52 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df Jul 22 20:40:52 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-866dfa94-76eb-43b5-8517-6468f86fffe3 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-83e40a01-5987-48b1-bc22-2825df248aaf-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:52 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-8e233bb4-21ea-4e4b-b84f-6f048d0487df" returned: 0 in 0.293s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Lock "cinder-quobyte-8e233bb4-21ea-4e4b-b84f-6f048d0487df" released by "delete_volume" :: held 0.870s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Created reservations ['5bd76f6f-baa0-453c-9cea-56c338b24c05', '86418657-f289-43e5-b5d8-970f6b415feb', 'f01828cf-d4e1-47ff-b2e0-ebf2a2228dde', '6005253d-229e-4a1c-a016-29db43962ccb'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:53 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:53 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:53 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Deleted volume successfully. Jul 22 20:40:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6a8e3b79-efb3-4e38-9594-2004ca440647 tempest-VolumeQuotasAdminTestJSON-2081358078 None] Lock "cinder-8e233bb4-21ea-4e4b-b84f-6f048d0487df-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Flow 'volume_create_manager' (bef3b421-b3c0-4c98-a5cb-80584341f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ca7919-d558-4bd0-af21-75c7f9c8620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ca7919-d558-4bd0-af21-75c7f9c8620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1450349690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aa0283-9fb9-426a-b82c-6115a8a4bf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00aed1e120e47dfa0cd0a280539bbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:54Z,use_quota=True,user_id='725acfe623af48d889c2239e0a99077e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a37dde0-e911-420a-8e59-1802b42969a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a37dde0-e911-420a-8e59-1802b42969a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cd9529-312e-4aef-9108-70642dcad1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cd9529-312e-4aef-9108-70642dcad1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aa0283-9fb9-426a-b82c-6115a8a4bf57', 'volume_name': 'volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77b7aa1-73e8-4201-9315-511de9b0d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77b7aa1-73e8-4201-9315-511de9b0d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440c83f0-d42b-4d47-b7db-d7835ecf20b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:54 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Volume d0aa0283-9fb9-426a-b82c-6115a8a4bf57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57', 'volume_size': 1} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1450349690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aa0283-9fb9-426a-b82c-6115a8a4bf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00aed1e120e47dfa0cd0a280539bbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:40:54Z,use_quota=True,user_id='725acfe623af48d889c2239e0a99077e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Creating volume d0aa0283-9fb9-426a-b82c-6115a8a4bf57 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:40:54 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:54 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 1073741824 Jul 22 20:40:54 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:54 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 1073741824" returned: 0 in 0.625s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:54 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 Jul 22 20:40:54 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:55 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57" returned: 0 in 0.295s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440c83f0-d42b-4d47-b7db-d7835ecf20b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7517a22-4355-472a-8a54-79e54eec69f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:40:55 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Volume volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 (d0aa0283-9fb9-426a-b82c-6115a8a4bf57): created successfully Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7517a22-4355-472a-8a54-79e54eec69f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Flow 'volume_create_manager' (bef3b421-b3c0-4c98-a5cb-80584341f856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:40:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0201114c-a1c5-4477-b68b-63f0c21f1600 tempest-VolumesTransfersV357Test-817646704 None] Created volume successfully. Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d8f39cd8-b099-4e15-a4a9-345be722a22f tempest-BackendsCapabilitiesAdminTestsJSON-1942223634 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87818) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 20:40:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0d9cb28-b2f2-4758-94d4-784220a383db tempest-BackendsCapabilitiesAdminTestsJSON-1942223634 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87818) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 20:40:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Acquiring lock "cinder-d0aa0283-9fb9-426a-b82c-6115a8a4bf57-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-d0aa0283-9fb9-426a-b82c-6115a8a4bf57-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Acquiring lock "cinder-quobyte-d0aa0283-9fb9-426a-b82c-6115a8a4bf57" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:40:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-quobyte-d0aa0283-9fb9-426a-b82c-6115a8a4bf57" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:40:56 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511a0d3-2827-4ca9-a276-df323af14656]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:40:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:56 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 Jul 22 20:40:56 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:57 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57" returned: 0 in 0.408s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:57 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57 Jul 22 20:40:57 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:57 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d0aa0283-9fb9-426a-b82c-6115a8a4bf57" returned: 0 in 0.330s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-quobyte-d0aa0283-9fb9-426a-b82c-6115a8a4bf57" released by "delete_volume" :: held 0.809s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Created reservations ['a1699be6-36ec-4bb9-ae7b-ed95965941a9', '568810a3-7b1a-4b44-8716-b5d903c39079', '550d9ef8-db78-45d3-9136-6f597ffd8797', '3cc025e2-5fb2-4998-8311-f53342c04d99'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:40:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:40:57 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:40:57 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:40:58 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 22 20:40:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:40:58 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:40:58 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Deleted volume successfully. Jul 22 20:40:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cc52386a-f560-4e01-9f37-b0c014f25916 tempest-VolumesTransfersV357Test-796435887 None] Lock "cinder-d0aa0283-9fb9-426a-b82c-6115a8a4bf57-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Flow 'volume_create_manager' (325a0387-e09c-4b6a-b1a1-3fa30891097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc46666-434c-4477-bdb0-9822551b586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc46666-434c-4477-bdb0-9822551b586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-928932006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f27ea4-ef87-47f6-90ba-edd5d80dddd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587c060d47e4eb69902b03806d55703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:07Z,use_quota=True,user_id='9c055ba4c8b04b24b62819e037a2b2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053226f6-6e8d-4391-96ab-24203d619808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053226f6-6e8d-4391-96ab-24203d619808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2602948-38e1-49a8-b835-2929bb4530ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2602948-38e1-49a8-b835-2929bb4530ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f27ea4-ef87-47f6-90ba-edd5d80dddd7', 'volume_name': 'volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874080df-70a5-4df8-8239-465b575f0065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874080df-70a5-4df8-8239-465b575f0065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0568266f-7530-4512-8555-68dc1f0ea9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:06 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Volume 22f27ea4-ef87-47f6-90ba-edd5d80dddd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7', 'volume_size': 1} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-928932006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f27ea4-ef87-47f6-90ba-edd5d80dddd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587c060d47e4eb69902b03806d55703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:07Z,use_quota=True,user_id='9c055ba4c8b04b24b62819e037a2b2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Creating volume 22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:06 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:06 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 1073741824 Jul 22 20:41:06 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9d5bfb2c-76a8-444c-8f05-71160990a3ef tempest-GroupSnapshotsV319Test-322234633 None] Group tempest-GroupSnapshotsV319Test-Group-1358584808: creating Jul 22 20:41:07 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 1073741824" returned: 0 in 0.617s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9d5bfb2c-76a8-444c-8f05-71160990a3ef tempest-GroupSnapshotsV319Test-322234633 None] Group tempest-GroupSnapshotsV319Test-Group-1358584808: created successfully Jul 22 20:41:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9d5bfb2c-76a8-444c-8f05-71160990a3ef tempest-GroupSnapshotsV319Test-322234633 None] Create group completed successfully. Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:07 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 Jul 22 20:41:07 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:07 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" returned: 0 in 0.325s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0568266f-7530-4512-8555-68dc1f0ea9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c091598-a4d0-4921-9131-9b5b9e937d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:07 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Volume volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 (22f27ea4-ef87-47f6-90ba-edd5d80dddd7): created successfully Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c091598-a4d0-4921-9131-9b5b9e937d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Flow 'volume_create_manager' (325a0387-e09c-4b6a-b1a1-3fa30891097b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5d667fc3-861d-48fc-a110-6aa57e71bffb tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Created volume successfully. Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Flow 'volume_create_manager' (a381c563-87ea-41a4-9be1-672d91106945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b736807-2b87-4b24-927c-fed5e5fb2765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b736807-2b87-4b24-927c-fed5e5fb2765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-83739923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd68717b-163d-4a3d-bf38-7886aba1082e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725b0f48e8ba4e13ac929d451f310d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:08Z,use_quota=True,user_id='bca12329b2a9415fa5a3ef45f2849858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5fdce4-029f-47c9-8d03-76dfa9872604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5fdce4-029f-47c9-8d03-76dfa9872604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263a4ce7-72f8-45ea-814f-8262d0e95fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:07 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263a4ce7-72f8-45ea-814f-8262d0e95fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd68717b-163d-4a3d-bf38-7886aba1082e', 'volume_name': 'volume-fd68717b-163d-4a3d-bf38-7886aba1082e', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f69e47-5967-4df2-88c8-4c57fc94620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f69e47-5967-4df2-88c8-4c57fc94620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0da3d9-c0c3-4b9c-b7bc-532a2eebb071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Volume fd68717b-163d-4a3d-bf38-7886aba1082e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd68717b-163d-4a3d-bf38-7886aba1082e', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Trying to clone fd68717b-163d-4a3d-bf38-7886aba1082e from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:41:08 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Image download 20.69 MB at 20.69 MB/s Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd65d9-38ee-4637-8eee-f2e1d09a82b9]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:08 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD Jul 22 20:41:08 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Creating offline snapshot a7cc218d-1bf2-4f54-956e-9dec069212f5 of volume 22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9246a76f-fca4-4ae3-a487-23a07d699f1e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:09 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD" returned: 0 in 0.584s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 is fetched for user bca12329b2a9415fa5a3ef45f2849858. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:41:09 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 Jul 22 20:41:09 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Flow 'volume_create_manager' (db503865-f39a-4726-a705-189b8170f50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09af940f-8b09-405e-9530-506dbcba9c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09af940f-8b09-405e-9530-506dbcba9c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566781769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=765e1e72-4004-40d2-82bd-61efc83f3353,host='devstack@QuobyteHD#QuobyteHD',id=4784d9c3-8a18-4784-8e5f-163bfbd3f68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6abdf9e0879475eb7a493932289e5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:09Z,use_quota=True,user_id='af293c3bd33442ebb25dddb00afd1d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90e10e6e-372b-4038-a56a-680c9ba17dce),volume_type_id=90e10e6e-372b-4038-a56a-680c9ba17dce)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddb1a91-0b83-42de-b8f8-86ff10f1feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddb1a91-0b83-42de-b8f8-86ff10f1feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4aff16d-251c-4f2c-8d3e-b9987502b906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4aff16d-251c-4f2c-8d3e-b9987502b906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4784d9c3-8a18-4784-8e5f-163bfbd3f68a', 'volume_name': 'volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3157b618-a3c2-4f3f-a363-7763f06c494e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3157b618-a3c2-4f3f-a363-7763f06c494e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57a2c39-4722-4b1e-9203-93fd111d0a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:09 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Volume 4784d9c3-8a18-4784-8e5f-163bfbd3f68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a', 'volume_size': 1} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eb56d2-64d2-4f53-9421-0fe3792feb9b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:09 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD Jul 22 20:41:09 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:09 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" returned: 0 in 0.484s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:09 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 1G Jul 22 20:41:09 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:09 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:10 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 1G" returned: 0 in 0.430s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:10 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 Jul 22 20:41:10 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:10 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:10 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 is being set with open permissions: ugo+rw Jul 22 20:41:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:10 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 Jul 22 20:41:10 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:10 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:10 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.info Jul 22 20:41:10 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:11 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.info" returned: 0 in 0.297s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:11 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.info is being set with open permissions: ugo+rw Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:11 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.info Jul 22 20:41:11 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:11 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.info" returned: 0 in 0.282s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.936s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=765e1e72-4004-40d2-82bd-61efc83f3353,created_at=2026-07-22T18:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566781769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=765e1e72-4004-40d2-82bd-61efc83f3353,host='devstack@QuobyteHD#QuobyteHD',id=4784d9c3-8a18-4784-8e5f-163bfbd3f68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6abdf9e0879475eb7a493932289e5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:09Z,use_quota=True,user_id='af293c3bd33442ebb25dddb00afd1d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90e10e6e-372b-4038-a56a-680c9ba17dce),volume_type_id=90e10e6e-372b-4038-a56a-680c9ba17dce)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Creating volume 4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:11 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:11 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a 1073741824 Jul 22 20:41:11 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e55bf137-84c2-4a60-a53b-d65746ed8a6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Create snapshot completed successfully Jul 22 20:41:11 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a 1073741824" returned: 0 in 0.610s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:12 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a Jul 22 20:41:12 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:12 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.442s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-83739923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd68717b-163d-4a3d-bf38-7886aba1082e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725b0f48e8ba4e13ac929d451f310d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:08Z,use_quota=True,user_id='bca12329b2a9415fa5a3ef45f2849858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Creating volume fd68717b-163d-4a3d-bf38-7886aba1082e {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:12 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57a2c39-4722-4b1e-9203-93fd111d0a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0b3c16-8cce-4059-b3a4-78f495f990ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:12 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 1073741824 Jul 22 20:41:12 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Volume volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a (4784d9c3-8a18-4784-8e5f-163bfbd3f68a): created successfully Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0b3c16-8cce-4059-b3a4-78f495f990ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Flow 'volume_create_manager' (db503865-f39a-4726-a705-189b8170f50c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-fda560b7-e1f1-4bbb-9b2d-b561ca8aebbb tempest-GroupSnapshotsV319Test-322234633 None] Created volume successfully. Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "cinder-a7cc218d-1bf2-4f54-956e-9dec069212f5-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:12 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 1073741824" returned: 0 in 0.555s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-a7cc218d-1bf2-4f54-956e-9dec069212f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "cinder-quobyte-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-quobyte-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "cinder-quobyte-a7cc218d-1bf2-4f54-956e-9dec069212f5" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-quobyte-a7cc218d-1bf2-4f54-956e-9dec069212f5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Deleting offline snapshot a7cc218d-1bf2-4f54-956e-9dec069212f5 of volume 22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:41:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] snapshot_file for this snap is: volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b617c50-8384-4a4a-858c-a86b50b47b39]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:13 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e Jul 22 20:41:13 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:13 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 Jul 22 20:41:13 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] GroupSnapshot 9b4b3949-7ed4-4cec-8a3b-3ea8fe09c986: creating. Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Group snapshot 9b4b3949-7ed4-4cec-8a3b-3ea8fe09c986: creating. {{(pid=87818) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:13 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:13 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e" returned: 0 in 0.481s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.127s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5" returned: 0 in 0.468s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Creating offline snapshot 84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b of volume 4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1139317-6b71-45fd-a8a4-ffdca06ad508]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[818060ab-ad6d-4175-918c-23fe84d39913]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Attempting download of 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume fd68717b-163d-4a3d-bf38-7886aba1082e. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca84cd-68d2-438a-8ab6-e79eacd5c8ef]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_lqnsp2kf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:13 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 Jul 22 20:41:13 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:13 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a Jul 22 20:41:13 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:13 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_lqnsp2kf Jul 22 20:41:13 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:14 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" returned: 0 in 0.634s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:14 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_lqnsp2kf" returned: 0 in 0.554s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:14 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_lqnsp2kf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:14 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 Jul 22 20:41:14 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" returned: 0 in 0.688s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:14 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b 1G Jul 22 20:41:14 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:14 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_lqnsp2kf Jul 22 20:41:14 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:14 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5" returned: 0 in 0.737s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:14 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5 Jul 22 20:41:14 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:15 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_lqnsp2kf" returned: 1 in 0.829s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_lqnsp2kf' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fc66be-598c-4cf6-a6ca-bf5c8332d30e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:15 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b 1G" returned: 0 in 1.076s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:15 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD Jul 22 20:41:15 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:15 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b Jul 22 20:41:15 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:15 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7.a7cc218d-1bf2-4f54-956e-9dec069212f5" returned: 0 in 0.587s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-quobyte-a7cc218d-1bf2-4f54-956e-9dec069212f5" released by "_delete_snapshot" :: held 2.605s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-quobyte-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" released by "delete_snapshot" :: held 2.637s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:15 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD" returned: 0 in 0.609s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] 36543c2a-70aa-4e05-bb91-fc14ca93a149 was qcow2, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Created reservations ['4c7544ce-2b14-416b-afd3-4c046afe6525', 'bd4f8929-d4ff-46f3-a4c3-83b3f637abd2', 'ae5b8ca5-3c2c-4b4d-8ab9-d7b91471230f', '56d65e3f-4765-49c1-8eb7-f0c2b4eceab3'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:15 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e Jul 22 20:41:15 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Delete snapshot completed successfully. Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7bca0171-949b-4809-acee-4bdb64e5e1d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-a7cc218d-1bf2-4f54-956e-9dec069212f5-delete_snapshot" released by "delete_snapshot" :: held 2.887s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:15 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" returned: 0 in 0.512s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:15 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:41:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:15 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b Jul 22 20:41:15 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:16 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" returned: 0 in 0.445s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:16 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.info Jul 22 20:41:16 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "cinder-22f27ea4-ef87-47f6-90ba-edd5d80dddd7-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-22f27ea4-ef87-47f6-90ba-edd5d80dddd7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "cinder-quobyte-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-quobyte-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d60c8-a02c-4f9c-9cb4-5a637333e7b7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:16 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.info" returned: 0 in 0.448s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:16 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 20:41:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:16 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 Jul 22 20:41:16 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:16 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.info Jul 22 20:41:16 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:17 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.info" returned: 0 in 0.293s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.602s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:17 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" returned: 0 in 0.482s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:17 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7 Jul 22 20:41:17 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5aa5cdc3-1549-488f-9eea-6ebc5f19cb57 tempest-GroupSnapshotsV319Test-322234633 None] group_snapshot 9b4b3949-7ed4-4cec-8a3b-3ea8fe09c986: created successfully Jul 22 20:41:17 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" returned: 0 in 0.293s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-quobyte-22f27ea4-ef87-47f6-90ba-edd5d80dddd7" released by "delete_volume" :: held 0.871s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Created reservations ['e7940da8-d213-46f1-be20-54a41629cbf1', 'ac482396-bf73-4e1b-92dc-e1b7d16c780c', 'f386265b-950b-4339-809f-66e4ecc54d85', '3ac84463-34c2-4055-b978-87f12711717d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:17 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:17 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.406s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:17 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Deleted volume successfully. Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-66d560a4-1abf-4b8e-b125-e146d8b10c05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1133240809 None] Lock "cinder-22f27ea4-ef87-47f6-90ba-edd5d80dddd7-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] group_snapshot 9b4b3949-7ed4-4cec-8a3b-3ea8fe09c986: deleting Jul 22 20:41:18 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e" returned: 0 in 2.804s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_9siwc9s5devstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:41:18 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Converted 112.00 MB image at 39.88 MB/s Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] group_snapshot 9b4b3949-7ed4-4cec-8a3b-3ea8fe09c986: deleting {{(pid=87818) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 20:41:18 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 1G Jul 22 20:41:18 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Acquiring lock "cinder-quobyte-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Lock "cinder-quobyte-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Acquiring lock "cinder-quobyte-84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Lock "cinder-quobyte-84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Deleting offline snapshot 84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b of volume 4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] snapshot_file for this snap is: volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[67194de9-1e86-4d4b-b5b5-29a6263ce0d6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:18 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b Jul 22 20:41:18 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:19 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 1G" returned: 0 in 0.591s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Downloaded image 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume fd68717b-163d-4a3d-bf38-7886aba1082e successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 for user bca12329b2a9415fa5a3ef45f2849858 is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Marking volume fd68717b-163d-4a3d-bf38-7886aba1082e as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Copying metadata from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 to fd68717b-163d-4a3d-bf38-7886aba1082e. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Creating volume glance metadata for volume fd68717b-163d-4a3d-bf38-7886aba1082e backed by image 36543c2a-70aa-4e05-bb91-fc14ca93a149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0da3d9-c0c3-4b9c-b7bc-532a2eebb071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd68717b-163d-4a3d-bf38-7886aba1082e', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4e1d11-c92b-44bf-9c2a-5f9a31af00dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:19 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Volume volume-fd68717b-163d-4a3d-bf38-7886aba1082e (fd68717b-163d-4a3d-bf38-7886aba1082e): created successfully Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4e1d11-c92b-44bf-9c2a-5f9a31af00dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Flow 'volume_create_manager' (a381c563-87ea-41a4-9be1-672d91106945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-074c8e76-8310-4585-8f60-d330a8e72511 tempest-VolumesExtendTest-836644439 None] Created volume successfully. Jul 22 20:41:19 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" returned: 0 in 0.570s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff832a-4608-401f-badb-92f0e97bf86d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:19 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a Jul 22 20:41:19 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:19 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" returned: 0 in 0.519s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:20 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b Jul 22 20:41:20 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:20 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d699a313-fbed-4e18-851d-3cd8c7059201]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:20 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e Jul 22 20:41:20 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:20 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" returned: 0 in 0.764s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:20 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b Jul 22 20:41:20 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:21 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e" returned: 0 in 0.637s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 2G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:21 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a.84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" returned: 0 in 0.508s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Lock "cinder-quobyte-84c2da8f-4b0a-4258-ae43-ef89ddfb1c0b" released by "_delete_snapshot" :: held 2.614s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Lock "cinder-quobyte-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" released by "delete_snapshot" :: held 2.680s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e 2G" returned: 0 in 0.271s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.956s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f3fa0434-b556-4d89-829c-c24535d0e89d tempest-VolumesExtendTest-836644439 None] Extend volume completed successfully. Jul 22 20:41:21 devstack cinder-volume[87818]: WARNING cinder.quota [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-595826576 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-595826576, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:41:21 devstack cinder-volume[87818]: WARNING cinder.quota [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-595826576 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-595826576, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:41:21 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] Created reservations ['774619f4-bd5f-4e53-92b8-cf838e967c6a', '90a2718b-2843-4256-b574-c4b6258132fd', '2289e686-ca1f-4855-a854-6a575ea151b0', '7e61c378-0185-483c-b593-f1085808c602'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-84894924-a237-44fd-8012-9e2a6c88e24a tempest-GroupSnapshotsV319Test-322234633 None] group_snapshot 9b4b3949-7ed4-4cec-8a3b-3ea8fe09c986: deleted successfully Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Acquiring lock "cinder-quobyte-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Lock "cinder-quobyte-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6722327-ea00-4131-b57f-05b3b13ca84f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:22 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a Jul 22 20:41:22 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Acquiring lock "cinder-fd68717b-163d-4a3d-bf38-7886aba1082e-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:22 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" returned: 0 in 0.511s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Lock "cinder-fd68717b-163d-4a3d-bf38-7886aba1082e-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:22 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=133,cinder:UPDATE=162,cinder:DELETE=11,cinder:INSERT=38 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:41:22 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a Jul 22 20:41:22 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=160,cinder:SELECT=150,cinder:INSERT=48,cinder:DELETE=13 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Acquiring lock "cinder-quobyte-fd68717b-163d-4a3d-bf38-7886aba1082e" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-fd68717b-163d-4a3d-bf38-7886aba1082e" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb99780-c474-4b93-868e-75fb8a30c518]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:23 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e Jul 22 20:41:23 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:23 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" returned: 0 in 0.421s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Lock "cinder-quobyte-4784d9c3-8a18-4784-8e5f-163bfbd3f68a" released by "delete_volume" :: held 1.022s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Created reservations ['8f639ab9-19a6-4c76-8d01-653cfabb6f3d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:23 devstack cinder-volume[87818]: WARNING cinder.quota [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-595826576 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-595826576, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Created reservations ['844138a4-c825-40a0-9bf7-5ee952f37141', '07c91c0c-558d-4f2a-98c1-788e593f3838', 'a252bc4b-bf3e-44aa-bce3-785207189f42', '73ca4cf1-4124-4e95-a2dd-60689510a305'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:23 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e" returned: 0 in 0.489s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:23 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e Jul 22 20:41:23 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:23 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:23 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:24 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.440s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:24 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fd68717b-163d-4a3d-bf38-7886aba1082e" returned: 0 in 0.519s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-300523c2-8672-4566-bfa6-8e0b4f39871a tempest-GroupSnapshotsV319Test-322234633 None] Delete group completed successfully. Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-fd68717b-163d-4a3d-bf38-7886aba1082e" released by "delete_volume" :: held 1.094s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Created reservations ['dde1bf67-1087-40aa-bdeb-46d8931d00f5', '7f0a289c-7317-4990-abc4-52c959a49f8e', '471e99bf-4dce-4313-8b16-14710ead20b7', 'cc4fe921-75bb-4972-9f16-a423e1b8827e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:24 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:24 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:24 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Deleted volume successfully. Jul 22 20:41:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-96009c09-3f0f-4143-bc88-1c1ecaed016a tempest-VolumesExtendTest-836644439 None] Lock "cinder-fd68717b-163d-4a3d-bf38-7886aba1082e-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:25 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Flow 'volume_create_manager' (e8da6bc8-4da2-45ca-8efa-9e7e1512df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d8152f-1481-448a-ba9c-24d21cab8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d8152f-1481-448a-ba9c-24d21cab8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-157298963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411aa789-3177-43e6-b908-05c68fa2b9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725b0f48e8ba4e13ac929d451f310d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:26Z,use_quota=True,user_id='bca12329b2a9415fa5a3ef45f2849858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f94e29-9878-4b0d-98f5-ddfcd0341e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f94e29-9878-4b0d-98f5-ddfcd0341e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4b24df-8019-4e19-bdc2-57b6490fab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4b24df-8019-4e19-bdc2-57b6490fab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411aa789-3177-43e6-b908-05c68fa2b9fc', 'volume_name': 'volume-411aa789-3177-43e6-b908-05c68fa2b9fc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d993f4-3c68-4692-a004-cf1a30a726d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d993f4-3c68-4692-a004-cf1a30a726d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3bd4b-5fbc-4f9e-a7fe-d953d8772b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:26 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Volume 411aa789-3177-43e6-b908-05c68fa2b9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411aa789-3177-43e6-b908-05c68fa2b9fc', 'volume_size': 1} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-157298963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411aa789-3177-43e6-b908-05c68fa2b9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725b0f48e8ba4e13ac929d451f310d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:26Z,use_quota=True,user_id='bca12329b2a9415fa5a3ef45f2849858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Creating volume 411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:26 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:26 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc 1073741824 Jul 22 20:41:26 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:26 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc 1073741824" returned: 0 in 0.556s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:26 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc Jul 22 20:41:26 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:27 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Flow 'volume_create_manager' (64013c1b-b490-4cc9-accd-40e6d6825ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236865aa-5ece-47f0-b575-b42519da58c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc" returned: 0 in 0.589s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236865aa-5ece-47f0-b575-b42519da58c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1987543521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586c2f9-3a79-4e4f-9428-06dd024ee594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9248e8c1b9904b0797da932cd1625a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:27Z,use_quota=True,user_id='d9df54082fae406e8517fb74c5e0ba07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6345a3ab-38fe-47be-8490-7c34164361fa),volume_type_id=6345a3ab-38fe-47be-8490-7c34164361fa)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e1e43c-8e1b-4a18-b897-360dc528b0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e1e43c-8e1b-4a18-b897-360dc528b0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d6753a-b564-45a3-b212-dcbb9ea5daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d6753a-b564-45a3-b212-dcbb9ea5daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c586c2f9-3a79-4e4f-9428-06dd024ee594', 'volume_name': 'volume-c586c2f9-3a79-4e4f-9428-06dd024ee594', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba7e1d-7b4e-4d7d-b825-10d91173bd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba7e1d-7b4e-4d7d-b825-10d91173bd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf6eff0-16c0-4ecf-a135-256956da8881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:27 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Volume c586c2f9-3a79-4e4f-9428-06dd024ee594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c586c2f9-3a79-4e4f-9428-06dd024ee594', 'volume_size': 1} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1987543521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586c2f9-3a79-4e4f-9428-06dd024ee594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9248e8c1b9904b0797da932cd1625a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:27Z,use_quota=True,user_id='d9df54082fae406e8517fb74c5e0ba07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6345a3ab-38fe-47be-8490-7c34164361fa),volume_type_id=6345a3ab-38fe-47be-8490-7c34164361fa)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Creating volume c586c2f9-3a79-4e4f-9428-06dd024ee594 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:27 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3bd4b-5fbc-4f9e-a7fe-d953d8772b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411aa789-3177-43e6-b908-05c68fa2b9fc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a56ea2-9f20-4a03-afd1-b0d46b49901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:27 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 1073741824 Jul 22 20:41:27 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:27 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Volume volume-411aa789-3177-43e6-b908-05c68fa2b9fc (411aa789-3177-43e6-b908-05c68fa2b9fc): created successfully Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a56ea2-9f20-4a03-afd1-b0d46b49901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Flow 'volume_create_manager' (e8da6bc8-4da2-45ca-8efa-9e7e1512df4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-db224544-69a0-4f77-b96a-1b009a9ff6ef tempest-VolumesExtendTest-836644439 None] Created volume successfully. Jul 22 20:41:27 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 1073741824" returned: 0 in 0.492s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:27 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 Jul 22 20:41:27 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:28 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594" returned: 0 in 0.431s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.022s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf6eff0-16c0-4ecf-a135-256956da8881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c586c2f9-3a79-4e4f-9428-06dd024ee594', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7e852b-5c2b-4f32-8af7-e55e1898c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Creating offline snapshot 2f653a34-6b88-4840-90d9-4962ea95d61e of volume 411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Volume volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 (c586c2f9-3a79-4e4f-9428-06dd024ee594): created successfully Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7e852b-5c2b-4f32-8af7-e55e1898c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Flow 'volume_create_manager' (64013c1b-b490-4cc9-accd-40e6d6825ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd780378-23b0-40aa-a735-82839569c196]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9d3c72a4-11fa-4e98-8c95-c57653f2eee8 tempest-VolumeTypesAccessTest-929457591 None] Created volume successfully. Jul 22 20:41:28 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc Jul 22 20:41:28 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:28 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc" returned: 0 in 0.411s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:28 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e 1G Jul 22 20:41:28 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:29 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e 1G" returned: 0 in 0.452s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-411aa789-3177-43e6-b908-05c68fa2b9fc -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:29 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-411aa789-3177-43e6-b908-05c68fa2b9fc -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e Jul 22 20:41:29 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Acquiring lock "cinder-c586c2f9-3a79-4e4f-9428-06dd024ee594-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Lock "cinder-c586c2f9-3a79-4e4f-9428-06dd024ee594-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Acquiring lock "cinder-quobyte-c586c2f9-3a79-4e4f-9428-06dd024ee594" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Lock "cinder-quobyte-c586c2f9-3a79-4e4f-9428-06dd024ee594" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f14c869-e5b6-415e-9d39-2c7e862e292a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:29 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-411aa789-3177-43e6-b908-05c68fa2b9fc -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e" returned: 0 in 0.397s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:29 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e is being set with open permissions: ugo+rw Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:29 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e Jul 22 20:41:29 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:29 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 Jul 22 20:41:29 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:29 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:30 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.info Jul 22 20:41:30 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:30 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594" returned: 0 in 0.425s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:30 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594 Jul 22 20:41:30 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:30 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.info" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:30 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.info is being set with open permissions: ugo+rw Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:30 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c586c2f9-3a79-4e4f-9428-06dd024ee594" returned: 0 in 0.256s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:30 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.info Jul 22 20:41:30 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Lock "cinder-quobyte-c586c2f9-3a79-4e4f-9428-06dd024ee594" released by "delete_volume" :: held 0.737s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:30 devstack cinder-volume[87818]: WARNING cinder.quota [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2010753463 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2010753463, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:41:30 devstack cinder-volume[87818]: WARNING cinder.quota [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2010753463 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2010753463, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Created reservations ['2885f1c2-3a8f-4d37-98fa-c35de690f550', '88a84611-96d4-419a-a955-4cf46166a0ba', '3d48c417-3973-4dfd-b101-bf5323291f07', '81afda50-8b2a-40b2-ae3d-6297313f4f69'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:30 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:30 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:30 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.info" returned: 0 in 0.294s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0b82e7f1-8d47-4246-8d9c-35f95902764f tempest-VolumesExtendTest-836644439 None] Create snapshot completed successfully Jul 22 20:41:30 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.410s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Deleted volume successfully. Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1d12a711-a823-4268-b9f0-c76dd8389ba9 tempest-VolumeTypesAccessTest-929457591 None] Lock "cinder-c586c2f9-3a79-4e4f-9428-06dd024ee594-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:30 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Flow 'volume_create_manager' (f8e2bbd8-d78b-4f57-8978-7e2d5f564f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194550e9-f59b-4654-8318-ba996b0d1d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194550e9-f59b-4654-8318-ba996b0d1d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2029548214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a656ea46-0363-4f90-a134-97630dc62f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407deacfa8074677be85fadae95bac6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:31Z,use_quota=True,user_id='305cd5813f4549cfb5b2485588f7c34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89760364-e150-4caa-9952-7d305274b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89760364-e150-4caa-9952-7d305274b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358f8b42-443b-41aa-956c-063de9fd456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358f8b42-443b-41aa-956c-063de9fd456a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a656ea46-0363-4f90-a134-97630dc62f7a', 'volume_name': 'volume-a656ea46-0363-4f90-a134-97630dc62f7a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9470a687-157a-4f29-b3fd-3d8fbe80c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9470a687-157a-4f29-b3fd-3d8fbe80c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650e66a8-50d0-43d2-abc3-6497ddfcb229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:31 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Volume a656ea46-0363-4f90-a134-97630dc62f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a656ea46-0363-4f90-a134-97630dc62f7a', 'volume_size': 1} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2029548214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a656ea46-0363-4f90-a134-97630dc62f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407deacfa8074677be85fadae95bac6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:31Z,use_quota=True,user_id='305cd5813f4549cfb5b2485588f7c34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Creating volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:31 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:31 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a 1073741824 Jul 22 20:41:31 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:31 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a 1073741824" returned: 0 in 0.521s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:31 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a Jul 22 20:41:31 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:31 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.339s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650e66a8-50d0-43d2-abc3-6497ddfcb229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a656ea46-0363-4f90-a134-97630dc62f7a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c926d5c-a9db-4e82-ae44-533e006cdefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b301a1-5c13-4692-93ba-e4fc4f5a796b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:31 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Volume volume-a656ea46-0363-4f90-a134-97630dc62f7a (a656ea46-0363-4f90-a134-97630dc62f7a): created successfully Jul 22 20:41:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c926d5c-a9db-4e82-ae44-533e006cdefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Flow 'volume_create_manager' (f8e2bbd8-d78b-4f57-8978-7e2d5f564f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a7ddebf5-2e5c-4fa2-81e2-151ab5dbe97e tempest-SnapshotsActionsTest-1828651929 None] Created volume successfully. Jul 22 20:41:32 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc Jul 22 20:41:32 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:32 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc" returned: 0 in 0.387s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e 2G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e 2G" returned: 0 in 0.128s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.558s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b22b70da-71bf-4389-9e3e-abf8680ff54e tempest-VolumesExtendTest-836644439 None] Extend volume completed successfully. Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Acquiring lock "cinder-2f653a34-6b88-4840-90d9-4962ea95d61e-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Lock "cinder-2f653a34-6b88-4840-90d9-4962ea95d61e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Acquiring lock "cinder-quobyte-411aa789-3177-43e6-b908-05c68fa2b9fc" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-411aa789-3177-43e6-b908-05c68fa2b9fc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Acquiring lock "cinder-quobyte-2f653a34-6b88-4840-90d9-4962ea95d61e" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-2f653a34-6b88-4840-90d9-4962ea95d61e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Deleting offline snapshot 2f653a34-6b88-4840-90d9-4962ea95d61e of volume 411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] snapshot_file for this snap is: volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcab1b1-4548-487b-9838-3e8744acb9ca]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:33 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e Jul 22 20:41:33 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Creating offline snapshot cd30f1d7-aaf8-455c-a8ba-9081a4cad270 of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[000918d7-1806-4bb7-bd5b-661db7195f32]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:33 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e" returned: 0 in 0.437s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-411aa789-3177-43e6-b908-05c68fa2b9fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a1ad6c-bdb2-4a2e-ab13-0536d6582d57]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:33 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a Jul 22 20:41:33 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:33 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc Jul 22 20:41:33 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:33 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:33 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 1G Jul 22 20:41:33 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:33 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc" returned: 0 in 0.413s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:33 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e Jul 22 20:41:33 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:34 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 1G" returned: 0 in 0.487s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:34 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e" returned: 0 in 0.410s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:34 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:34 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:34 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e Jul 22 20:41:34 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:34 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc.2f653a34-6b88-4840-90d9-4962ea95d61e" returned: 0 in 0.273s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:34 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.302s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:34 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 is being set with open permissions: ugo+rw Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:34 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:34 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-2f653a34-6b88-4840-90d9-4962ea95d61e" released by "_delete_snapshot" :: held 1.683s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-411aa789-3177-43e6-b908-05c68fa2b9fc" released by "delete_snapshot" :: held 1.715s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Created reservations ['e789904a-7a8a-4487-9518-e80851e9071d', 'ab8f1420-8126-4701-aa9e-37927d1e23fd', 'e6d750c7-d671-42a2-a9ba-b88b384f2327', '5a3c02ba-d218-4e57-a4ef-477922f85ed6'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:34 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Delete snapshot completed successfully. Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ae7b14a2-a1ee-46ec-8a8d-0549d8b45e4d tempest-VolumesExtendTest-836644439 None] Lock "cinder-2f653a34-6b88-4840-90d9-4962ea95d61e-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:34 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.271s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:34 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.info Jul 22 20:41:34 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Acquiring lock "cinder-411aa789-3177-43e6-b908-05c68fa2b9fc-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Lock "cinder-411aa789-3177-43e6-b908-05c68fa2b9fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:35 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.info" returned: 0 in 0.328s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:35 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.info is being set with open permissions: ugo+rw Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Acquiring lock "cinder-quobyte-411aa789-3177-43e6-b908-05c68fa2b9fc" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-411aa789-3177-43e6-b908-05c68fa2b9fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:35 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.info Jul 22 20:41:35 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b567f51-43a8-47b3-ac94-ccf9d243b033]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:35 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc Jul 22 20:41:35 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:35 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.info" returned: 0 in 0.287s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-12bd7c57-a9eb-4b72-a08a-5532e08b6aa7 tempest-SnapshotsActionsTest-1828651929 None] Create snapshot completed successfully Jul 22 20:41:35 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc" returned: 0 in 0.386s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:35 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc Jul 22 20:41:35 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:35 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-411aa789-3177-43e6-b908-05c68fa2b9fc" returned: 0 in 0.262s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Lock "cinder-quobyte-411aa789-3177-43e6-b908-05c68fa2b9fc" released by "delete_volume" :: held 0.725s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:35 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Created reservations ['df60620d-24af-4278-a8e8-3a1b06fc49de', 'eb7c8b68-f68b-4e64-9994-eb2a2f20c6f8', 'f1ad47ba-193a-4c13-b263-cdbc84ddac41', '6dafddf8-5e31-406d-a77c-36d3fd9c2676'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:36 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:36 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:36 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.294s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Deleted volume successfully. Jul 22 20:41:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a59d09ca-3501-4873-a6f7-322f7eb6df5d tempest-VolumesExtendTest-836644439 None] Lock "cinder-411aa789-3177-43e6-b908-05c68fa2b9fc-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Creating offline snapshot 77fc2569-2ef2-4375-a667-a5d0e0324527 of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c54d88-147c-4885-bf17-65da1592023f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:37 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:37 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:37 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.452s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:37 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 1G Jul 22 20:41:37 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:38 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 1G" returned: 0 in 0.780s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:38 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 Jul 22 20:41:38 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:38 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527" returned: 0 in 0.381s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:38 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 is being set with open permissions: ugo+rw Jul 22 20:41:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:38 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 Jul 22 20:41:38 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:39 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527" returned: 0 in 0.290s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ad062eea-1491-47f0-8ce2-ca796608430f tempest-SnapshotsActionsTest-1828651929 None] Create snapshot completed successfully Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-77fc2569-2ef2-4375-a667-a5d0e0324527-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-77fc2569-2ef2-4375-a667-a5d0e0324527-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-77fc2569-2ef2-4375-a667-a5d0e0324527" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-77fc2569-2ef2-4375-a667-a5d0e0324527" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Deleting offline snapshot 77fc2569-2ef2-4375-a667-a5d0e0324527 of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] snapshot_file for this snap is: volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de68511-f83a-42c1-adb7-b9e7d0896ff2]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:39 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 Jul 22 20:41:39 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:40 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527" returned: 0 in 0.396s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac63ff17-3d46-4542-b619-5736599c261a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:40 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:40 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:40 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.477s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Flow 'volume_create_manager' (61c46623-bbe8-427c-8626-b519a102203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:40 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6320c478-26d6-48e2-af4e-96c4d38f53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:40 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6320c478-26d6-48e2-af4e-96c4d38f53ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-305245188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909a981f-619d-43a8-9d6f-2ee31754e0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7950d4d917c42ae88e38a205bc65623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:41Z,use_quota=True,user_id='0711a0b061974bb2b4e06823cfa0d123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5dee93-0af2-494d-8595-59b8b56be6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5dee93-0af2-494d-8595-59b8b56be6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fc0f10-1a81-421f-b97f-67dcbde04bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fc0f10-1a81-421f-b97f-67dcbde04bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909a981f-619d-43a8-9d6f-2ee31754e0fc', 'volume_name': 'volume-909a981f-619d-43a8-9d6f-2ee31754e0fc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89562e6a-025b-4ad0-9347-6b33b119c0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89562e6a-025b-4ad0-9347-6b33b119c0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c879b4e-9432-47d9-a321-9b88c1695473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:40 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Volume 909a981f-619d-43a8-9d6f-2ee31754e0fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909a981f-619d-43a8-9d6f-2ee31754e0fc', 'volume_size': 1} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-305245188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909a981f-619d-43a8-9d6f-2ee31754e0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7950d4d917c42ae88e38a205bc65623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:41Z,use_quota=True,user_id='0711a0b061974bb2b4e06823cfa0d123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Creating volume 909a981f-619d-43a8-9d6f-2ee31754e0fc {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:40 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:40 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc 1073741824 Jul 22 20:41:40 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Flow 'volume_create_manager' (60655558-8771-4f89-af8b-73bebe691365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d96b67-c84a-4a2f-b00c-2cb47cc16bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d96b67-c84a-4a2f-b00c-2cb47cc16bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2042306752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fed262b-4a80-42c9-8a46-2edceed57c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2343bc3c891d4ecebfecdea9a40ff729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:41Z,use_quota=True,user_id='7fd7e9dc9011421aad59615a98726042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834de855-586f-49f7-8d63-b6dad3ee4c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834de855-586f-49f7-8d63-b6dad3ee4c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d373b8-2af6-473f-ad5e-9527e4d9dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d373b8-2af6-473f-ad5e-9527e4d9dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fed262b-4a80-42c9-8a46-2edceed57c57', 'volume_name': 'volume-6fed262b-4a80-42c9-8a46-2edceed57c57', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396789c7-044a-4b83-8bbb-d5bb28060cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396789c7-044a-4b83-8bbb-d5bb28060cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1acfb36-7196-4fc2-8630-4768e5753026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Volume 6fed262b-4a80-42c9-8a46-2edceed57c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fed262b-4a80-42c9-8a46-2edceed57c57', 'volume_size': 1} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:41 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527" returned: 0 in 0.556s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:41 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527 Jul 22 20:41:41 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:41 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:41 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:41 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc 1073741824" returned: 0 in 0.612s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:41 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc Jul 22 20:41:41 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:41 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.77fc2569-2ef2-4375-a667-a5d0e0324527" returned: 0 in 0.306s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:41 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.312s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-77fc2569-2ef2-4375-a667-a5d0e0324527" released by "_delete_snapshot" :: held 1.862s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" released by "delete_snapshot" :: held 1.898s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Created reservations ['2e19c4cb-9e86-43f5-8db3-da97588b851b', 'bc110129-fd3a-4547-9dfe-a071da79b7b7', 'c40c6a92-8964-4c0d-9a5f-bc7bdf834926', '77d54151-3caf-471b-a7c8-963d27d79260'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Delete snapshot completed successfully. Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-92eb8089-d939-49b1-8122-df997275d347 tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-77fc2569-2ef2-4375-a667-a5d0e0324527-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:41 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2042306752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fed262b-4a80-42c9-8a46-2edceed57c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2343bc3c891d4ecebfecdea9a40ff729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:41Z,use_quota=True,user_id='7fd7e9dc9011421aad59615a98726042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Creating volume 6fed262b-4a80-42c9-8a46-2edceed57c57 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:41 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c879b4e-9432-47d9-a321-9b88c1695473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909a981f-619d-43a8-9d6f-2ee31754e0fc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:41 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 1073741824 Jul 22 20:41:41 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a40a88-766b-48d6-974b-86a254fb2c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Volume volume-909a981f-619d-43a8-9d6f-2ee31754e0fc (909a981f-619d-43a8-9d6f-2ee31754e0fc): created successfully Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a40a88-766b-48d6-974b-86a254fb2c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Flow 'volume_create_manager' (61c46623-bbe8-427c-8626-b519a102203e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0722263f-09ae-4e07-ae2f-c9a31f0b1d4c tempest-VolumesNegativeTest-1545407563 None] Created volume successfully. Jul 22 20:41:42 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 1073741824" returned: 0 in 0.438s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:42 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 Jul 22 20:41:42 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:42 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57" returned: 0 in 0.260s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1acfb36-7196-4fc2-8630-4768e5753026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fed262b-4a80-42c9-8a46-2edceed57c57', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c00928-08a9-45a9-b823-ecfdac382b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Volume volume-6fed262b-4a80-42c9-8a46-2edceed57c57 (6fed262b-4a80-42c9-8a46-2edceed57c57): created successfully Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c00928-08a9-45a9-b823-ecfdac382b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Flow 'volume_create_manager' (60655558-8771-4f89-af8b-73bebe691365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:42 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-62c26a68-5a4f-4447-862b-3606e27df0a2 tempest-AttachVolumeNegativeTest-1912222297 None] Created volume successfully. Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Creating offline snapshot 30a789dd-260f-42e5-ab93-8dcc071fbea6 of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fdfed4-4160-495e-8c8d-a0361d2b0e86]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:43 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:43 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:43 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.580s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:43 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 1G Jul 22 20:41:43 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-b8cc3c13-5021-4632-b542-18b98d661741 req-b7cbb51e-31ee-41ac-bccd-fbf6e8063b0b tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:44 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 1G" returned: 0 in 0.572s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:44 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 Jul 22 20:41:44 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:44 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6" returned: 0 in 0.366s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:44 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 is being set with open permissions: ugo+rw Jul 22 20:41:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:44 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 Jul 22 20:41:44 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:45 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6" returned: 0 in 0.318s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-b8cc3c13-5021-4632-b542-18b98d661741 req-b7cbb51e-31ee-41ac-bccd-fbf6e8063b0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.091s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-b8cc3c13-5021-4632-b542-18b98d661741 req-b7cbb51e-31ee-41ac-bccd-fbf6e8063b0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-42fae9cf-2235-478b-a6b9-ec280c3c40f4 tempest-SnapshotsActionsTest-1828651929 None] Create snapshot completed successfully Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-b8cc3c13-5021-4632-b542-18b98d661741 req-b7cbb51e-31ee-41ac-bccd-fbf6e8063b0b tempest-AttachVolumeNegativeTest-1912222297 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-6fed262b-4a80-42c9-8a46-2edceed57c57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5db0394c-67ff-47fd-8d0a-a95b534605aa', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:41:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-b8cc3c13-5021-4632-b542-18b98d661741 req-b7cbb51e-31ee-41ac-bccd-fbf6e8063b0b tempest-AttachVolumeNegativeTest-1912222297 None] attachment_update completed successfully. Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Flow 'volume_create_manager' (ea154cc1-2a41-452a-92ad-6d81647723df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10b95c3-061f-4bb2-9903-ac9679e737a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10b95c3-061f-4bb2-9903-ac9679e737a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-134646428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80b4d52-c9b3-4f9b-97bc-2d06f8db1241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7720058450044779f086ca6dfd5e7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:46Z,use_quota=True,user_id='7dae4a6eb25c4e8992220021e90349c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0560a3-6f97-462e-8a15-c90fda4b2ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0560a3-6f97-462e-8a15-c90fda4b2ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf607d88-a73f-4708-bc11-f26c0f5cfd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf607d88-a73f-4708-bc11-f26c0f5cfd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80b4d52-c9b3-4f9b-97bc-2d06f8db1241', 'volume_name': 'volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9969f5d2-2e54-4693-bc95-c400d489322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9969f5d2-2e54-4693-bc95-c400d489322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695318cb-3b00-4543-83d8-e5db446a2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:45 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Volume d80b4d52-c9b3-4f9b-97bc-2d06f8db1241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241', 'volume_size': 1} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-134646428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80b4d52-c9b3-4f9b-97bc-2d06f8db1241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7720058450044779f086ca6dfd5e7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:46Z,use_quota=True,user_id='7dae4a6eb25c4e8992220021e90349c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Creating volume d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:45 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-30a789dd-260f-42e5-ab93-8dcc071fbea6-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:45 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 1073741824 Jul 22 20:41:45 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-30a789dd-260f-42e5-ab93-8dcc071fbea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-30a789dd-260f-42e5-ab93-8dcc071fbea6" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-30a789dd-260f-42e5-ab93-8dcc071fbea6" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Deleting offline snapshot 30a789dd-260f-42e5-ab93-8dcc071fbea6 of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] snapshot_file for this snap is: volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe6dc1b-a942-49d8-9633-186980d19b48]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:46 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 Jul 22 20:41:46 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:46 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 1073741824" returned: 0 in 0.677s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:46 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 Jul 22 20:41:46 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:46 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6" returned: 0 in 0.581s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe2c9cc-a352-48cf-ad6d-b6b65464db2f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:46 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:46 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:46 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695318cb-3b00-4543-83d8-e5db446a2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960b9b38-5b26-453f-9fd6-d121be505a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:46 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Volume volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 (d80b4d52-c9b3-4f9b-97bc-2d06f8db1241): created successfully Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960b9b38-5b26-453f-9fd6-d121be505a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Flow 'volume_create_manager' (ea154cc1-2a41-452a-92ad-6d81647723df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:46 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bc93f21c-1ddb-40bf-b479-16b7880de979 tempest-VolumesTransfersV355Test-828981549 None] Created volume successfully. Jul 22 20:41:47 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.456s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:47 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 Jul 22 20:41:47 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:47 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6" returned: 0 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:47 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6 Jul 22 20:41:47 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:47 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.30a789dd-260f-42e5-ab93-8dcc071fbea6" returned: 0 in 0.280s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-30a789dd-260f-42e5-ab93-8dcc071fbea6" released by "_delete_snapshot" :: held 1.895s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" released by "delete_snapshot" :: held 1.944s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:47 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Created reservations ['c652bae6-60a9-43a7-858f-253462d2c391', 'c2f2a49c-870f-4580-b75b-4132e0f54e7e', '8ddbccb4-ea00-4076-b62f-bf6fb5252c0f', '53de08b0-a5d6-4971-9c5a-f046bd081d52'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:48 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Delete snapshot completed successfully. Jul 22 20:41:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57ba962b-65e6-44ee-aea6-c3d4365ddb5f tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-30a789dd-260f-42e5-ab93-8dcc071fbea6-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:48 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e06462b9-77c7-4d52-afe8-c64d5d6a3f9c tempest-VolumesTransfersV355Test-1421766811 None] Transfer volume completed successfully. Jul 22 20:41:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Acquiring lock "cinder-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Creating offline snapshot c0fa6b57-bd0f-4f34-8978-af73984809de of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Acquiring lock "cinder-quobyte-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7832e4b6-a5c1-468e-9bb3-7c5a055e5e6f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-quobyte-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241" acquired by "delete_volume" :: waited 0.058s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b3c7f8-a24d-4561-b8ad-9d4f508b1552]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:50 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:50 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:50 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 Jul 22 20:41:50 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:50 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.579s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:50 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de 1G Jul 22 20:41:50 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:50 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241" returned: 0 in 0.673s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:50 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241 Jul 22 20:41:50 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:51 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241" returned: 0 in 0.481s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-quobyte-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241" released by "delete_volume" :: held 1.221s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Created reservations ['0c19f24c-7a75-4a17-8108-0780b1cf175e', 'f12a67d2-69d6-4131-bc5d-ba4dab82e6de', '424d9711-2c90-4146-8625-78d83236278f', '44b51e2e-9e28-4368-9147-967521319836'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:51 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de 1G" returned: 0 in 0.760s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:51 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de Jul 22 20:41:51 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:51 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:51 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:52 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de" returned: 0 in 0.521s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:52 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de is being set with open permissions: ugo+rw Jul 22 20:41:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:52 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.464s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:52 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:52 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de Jul 22 20:41:52 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Deleted volume successfully. Jul 22 20:41:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-39788d78-8c2d-4c3e-9905-ee037430a665 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-d80b4d52-c9b3-4f9b-97bc-2d06f8db1241-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:52 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de" returned: 0 in 0.508s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-005adb28-1869-4d18-97bf-92e570a1b46c tempest-SnapshotsActionsTest-1828651929 None] Create snapshot completed successfully Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Flow 'volume_create_manager' (707a1cb5-12b1-4112-9c46-a0b258ad37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b58a6e-9f98-4906-8fd6-a7a42e29a274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b58a6e-9f98-4906-8fd6-a7a42e29a274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-615281424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec2c26b-932d-4f09-bba2-ce824d08347d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7720058450044779f086ca6dfd5e7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:53Z,use_quota=True,user_id='7dae4a6eb25c4e8992220021e90349c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30dd08b-ee9e-477b-ac33-fd5240ce2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30dd08b-ee9e-477b-ac33-fd5240ce2b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6577b4b4-3391-4368-a2d6-ed8130c0a644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6577b4b4-3391-4368-a2d6-ed8130c0a644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec2c26b-932d-4f09-bba2-ce824d08347d', 'volume_name': 'volume-7ec2c26b-932d-4f09-bba2-ce824d08347d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90879b05-3675-41f4-b7b5-342c16dcddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90879b05-3675-41f4-b7b5-342c16dcddab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0339d917-b17a-4d27-9713-d11a55125b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:53 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Volume 7ec2c26b-932d-4f09-bba2-ce824d08347d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec2c26b-932d-4f09-bba2-ce824d08347d', 'volume_size': 1} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-615281424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec2c26b-932d-4f09-bba2-ce824d08347d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7720058450044779f086ca6dfd5e7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:41:53Z,use_quota=True,user_id='7dae4a6eb25c4e8992220021e90349c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Creating volume 7ec2c26b-932d-4f09-bba2-ce824d08347d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:41:53 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:53 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d 1073741824 Jul 22 20:41:53 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-c0fa6b57-bd0f-4f34-8978-af73984809de-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-c0fa6b57-bd0f-4f34-8978-af73984809de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-c0fa6b57-bd0f-4f34-8978-af73984809de" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-c0fa6b57-bd0f-4f34-8978-af73984809de" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Deleting offline snapshot c0fa6b57-bd0f-4f34-8978-af73984809de of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] snapshot_file for this snap is: volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa764be-0ce0-4d4a-b079-7971a9d2b71f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:54 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de Jul 22 20:41:54 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:54 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d 1073741824" returned: 0 in 0.812s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:54 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d Jul 22 20:41:54 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:54 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de" returned: 0 in 0.791s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff70502-5301-403d-b727-e4aae2aad5c2]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:54 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d" returned: 0 in 0.319s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0339d917-b17a-4d27-9713-d11a55125b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec2c26b-932d-4f09-bba2-ce824d08347d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d30f71-35fc-43aa-9e88-9edc88cfe9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:41:54 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Volume volume-7ec2c26b-932d-4f09-bba2-ce824d08347d (7ec2c26b-932d-4f09-bba2-ce824d08347d): created successfully Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d30f71-35fc-43aa-9e88-9edc88cfe9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:41:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Flow 'volume_create_manager' (707a1cb5-12b1-4112-9c46-a0b258ad37d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:41:54 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9b1870af-ae6c-4ede-8867-af7893331723 tempest-VolumesTransfersV355Test-828981549 None] Created volume successfully. Jul 22 20:41:54 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:54 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:55 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.514s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:55 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de Jul 22 20:41:55 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:55 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de" returned: 0 in 0.557s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:55 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de Jul 22 20:41:55 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Acquiring lock "cinder-7ec2c26b-932d-4f09-bba2-ce824d08347d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-7ec2c26b-932d-4f09-bba2-ce824d08347d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:55 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c0fa6b57-bd0f-4f34-8978-af73984809de" returned: 0 in 0.340s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-c0fa6b57-bd0f-4f34-8978-af73984809de" released by "_delete_snapshot" :: held 2.338s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" released by "delete_snapshot" :: held 2.374s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Acquiring lock "cinder-quobyte-7ec2c26b-932d-4f09-bba2-ce824d08347d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-quobyte-7ec2c26b-932d-4f09-bba2-ce824d08347d" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf0ba5-d4c2-4a04-a0fe-3ac833e300dc]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Created reservations ['665e7e7a-e831-4746-9dbd-d0716a2de82b', '9c58414d-0d60-4e6e-9065-78c9653d13ab', '70fbd19f-d214-4a20-a0d2-d0ba74dad923', '4c432189-cd7f-493d-89cc-2a660b4eb732'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:56 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Delete snapshot completed successfully. Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-64b21dfa-57fa-4e7b-97e8-a75c85b14c2d tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-c0fa6b57-bd0f-4f34-8978-af73984809de-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:56 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d Jul 22 20:41:56 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:56 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d" returned: 0 in 0.455s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:56 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d Jul 22 20:41:56 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:56 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7ec2c26b-932d-4f09-bba2-ce824d08347d" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-quobyte-7ec2c26b-932d-4f09-bba2-ce824d08347d" released by "delete_volume" :: held 0.872s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Created reservations ['7de6bf11-9ec5-4fc1-bb8a-b2ef174782fa', 'ef7f4fdc-8912-4b87-858a-d53b68a100b4', 'b4870fc3-e13a-408c-822d-6bc7ff67539a', '6ea79b03-55bc-4681-8976-2b58d9eccd0f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:57 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:41:57 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Creating offline snapshot c449e561-4e18-462d-b5b7-1c29a73d550b of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[782e1d4e-3fbe-4eb8-ad3d-8a48126ed269]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:57 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:41:57 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:57 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.306s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:41:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Deleted volume successfully. Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9726e375-fe3a-4be7-b43e-2800e9036c79 tempest-VolumesTransfersV355Test-731522733 None] Lock "cinder-7ec2c26b-932d-4f09-bba2-ce824d08347d-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:41:57 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.487s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:41:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:57 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b 1G Jul 22 20:41:57 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:58 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b 1G" returned: 0 in 0.816s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:58 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b Jul 22 20:41:58 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:59 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b" returned: 0 in 0.574s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:59 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b is being set with open permissions: ugo+rw Jul 22 20:41:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:41:59 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b Jul 22 20:41:59 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:41:59 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 22 20:41:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b" returned: 0 in 0.326s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:41:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:41:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5cfa5931-b711-4060-895b-55de8274b63e tempest-SnapshotsActionsTest-1828651929 None] Create snapshot completed successfully Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-c449e561-4e18-462d-b5b7-1c29a73d550b-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-c449e561-4e18-462d-b5b7-1c29a73d550b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Acquiring lock "cinder-quobyte-c449e561-4e18-462d-b5b7-1c29a73d550b" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-c449e561-4e18-462d-b5b7-1c29a73d550b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Deleting offline snapshot c449e561-4e18-462d-b5b7-1c29a73d550b of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] snapshot_file for this snap is: volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e70809-38b8-461e-92fe-55f0cb8d46c8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:01 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b Jul 22 20:42:01 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:01 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b" returned: 0 in 0.845s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:42:01 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c645fb34-05c2-4c85-99b1-1eefd3a6d490]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:02 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:42:02 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:02 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 1.050s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:42:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:02 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b Jul 22 20:42:02 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:03 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b" returned: 0 in 0.621s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:03 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b Jul 22 20:42:03 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:03 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.c449e561-4e18-462d-b5b7-1c29a73d550b" returned: 0 in 0.377s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-c449e561-4e18-462d-b5b7-1c29a73d550b" released by "_delete_snapshot" :: held 3.041s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" released by "delete_snapshot" :: held 3.078s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:04 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Created reservations ['31699915-b4b4-4bec-8e8e-b35f2fa8e6d5', '3de46021-e20b-4259-a760-dbd2c12e7218', 'a0b04a88-5077-4fb6-a41f-e70a006f315b', 'e7f86c4b-0414-4ab8-933b-255d22ecf58f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:42:04 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Delete snapshot completed successfully. Jul 22 20:42:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ee1bba4e-4739-4ab9-80e6-31e33febe9fd tempest-SnapshotsActionsTest-690425201 None] Lock "cinder-c449e561-4e18-462d-b5b7-1c29a73d550b-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "cinder-cd30f1d7-aaf8-455c-a8ba-9081a4cad270-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-cd30f1d7-aaf8-455c-a8ba-9081a4cad270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "cinder-quobyte-cd30f1d7-aaf8-455c-a8ba-9081a4cad270" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-quobyte-cd30f1d7-aaf8-455c-a8ba-9081a4cad270" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Deleting offline snapshot cd30f1d7-aaf8-455c-a8ba-9081a4cad270 of volume a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] snapshot_file for this snap is: volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[def6e2f9-1159-45ed-9d21-34174332223a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:06 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:42:06 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Acquiring lock "cinder-909a981f-619d-43a8-9d6f-2ee31754e0fc-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Lock "cinder-909a981f-619d-43a8-9d6f-2ee31754e0fc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Acquiring lock "cinder-quobyte-909a981f-619d-43a8-9d6f-2ee31754e0fc" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Lock "cinder-quobyte-909a981f-619d-43a8-9d6f-2ee31754e0fc" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[66851a00-aebb-441f-a03b-3b6884c86dc3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:06 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc Jul 22 20:42:06 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:06 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.539s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a656ea46-0363-4f90-a134-97630dc62f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a183c07-7245-4040-8d6d-d6dfc8889df8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:06 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a Jul 22 20:42:06 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:06 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc" returned: 0 in 0.442s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:06 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc Jul 22 20:42:06 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:06 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a" returned: 0 in 0.447s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:06 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:42:06 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:07 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-909a981f-619d-43a8-9d6f-2ee31754e0fc" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Lock "cinder-quobyte-909a981f-619d-43a8-9d6f-2ee31754e0fc" released by "delete_volume" :: held 0.841s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Created reservations ['02cf5d4a-36d1-45ae-a4c8-ec4f29855f3a', 'dfe60692-2d6f-429a-a196-3a054e8d7abe', '1a4de25e-66e3-46ad-b7c2-29492f09e047', '6038660e-9166-43c4-a8ce-06332e846e7f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:07 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:42:07 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:07 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.530s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:07 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270 Jul 22 20:42:07 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:07 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.496s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:42:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Deleted volume successfully. Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Flow 'volume_create_manager' (ed1887ba-5b45-4325-b580-59af3f16b93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e817e64f-ae5b-4bcb-a1cb-c918716c31d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e817e64f-ae5b-4bcb-a1cb-c918716c31d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2110434623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e54ccea-7818-4e3f-98c2-8e07fbb4d31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c826f07b5764c98a6d3f6c064b949b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:08Z,use_quota=True,user_id='c499e2c1e1a246c097893d49bae9a562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac34118-4a6a-4aa0-bad0-bd2c3838b3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:07 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac34118-4a6a-4aa0-bad0-bd2c3838b3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6c3a3a-0014-4c70-99fc-7f9b13a6b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6c3a3a-0014-4c70-99fc-7f9b13a6b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e54ccea-7818-4e3f-98c2-8e07fbb4d31d', 'volume_name': 'volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9917fe30-0406-46d9-8140-5da33abf206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9917fe30-0406-46d9-8140-5da33abf206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c323eccf-faca-4649-9a10-d1612560776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:07 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Volume 6e54ccea-7818-4e3f-98c2-8e07fbb4d31d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d', 'volume_size': 1} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2110434623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e54ccea-7818-4e3f-98c2-8e07fbb4d31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c826f07b5764c98a6d3f6c064b949b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:08Z,use_quota=True,user_id='c499e2c1e1a246c097893d49bae9a562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Creating volume 6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:42:08 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9d0ae0c4-9aef-4fbd-aed7-0d042a2f8e71 tempest-VolumesNegativeTest-1545407563 None] Lock "cinder-909a981f-619d-43a8-9d6f-2ee31754e0fc-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a.cd30f1d7-aaf8-455c-a8ba-9081a4cad270" returned: 0 in 0.547s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:08 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d 1073741824 Jul 22 20:42:08 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-quobyte-cd30f1d7-aaf8-455c-a8ba-9081a4cad270" released by "_delete_snapshot" :: held 2.221s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" released by "delete_snapshot" :: held 2.261s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Created reservations ['65db3ba9-d883-439c-8f1e-dfbb50dfa8cc', 'c4ed83ff-9510-49d3-93e7-de6c62e1ca9c', '4fdb2102-8379-48c8-9f1f-00a168f86430', '9c849e23-2dd9-4f80-9e0f-9447ab33311c'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:42:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Delete snapshot completed successfully. Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-508782a6-0433-43b0-a351-b973ad2da3c2 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-cd30f1d7-aaf8-455c-a8ba-9081a4cad270-delete_snapshot" released by "delete_snapshot" :: held 2.439s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:08 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d 1073741824" returned: 0 in 0.564s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:08 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d Jul 22 20:42:08 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:08 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c323eccf-faca-4649-9a10-d1612560776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7d7f0f-98d3-473d-8e8e-db0045a6e788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Volume volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d (6e54ccea-7818-4e3f-98c2-8e07fbb4d31d): created successfully Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7d7f0f-98d3-473d-8e8e-db0045a6e788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Flow 'volume_create_manager' (ed1887ba-5b45-4325-b580-59af3f16b93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4ecca43b-b818-4371-8286-7b37289daa8a tempest-VolumesCloneTest-626129712 None] Created volume successfully. Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "cinder-a656ea46-0363-4f90-a134-97630dc62f7a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-a656ea46-0363-4f90-a134-97630dc62f7a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a7f8b-7283-4f2a-b743-bdb6fa7c06ab]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:09 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a Jul 22 20:42:09 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:09 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a" returned: 0 in 0.396s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:09 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a Jul 22 20:42:09 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:09 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a656ea46-0363-4f90-a134-97630dc62f7a" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-quobyte-a656ea46-0363-4f90-a134-97630dc62f7a" released by "delete_volume" :: held 0.741s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Created reservations ['3be81695-b12c-44f4-a58e-0102dc127538', '938c42b3-ac02-48ff-9e77-d45b53f2d511', '0472f7e0-060a-43c0-9e5a-db4a30fe7eb6', '5863b105-752a-4b0f-98fc-ed1f57de636f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:10 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:42:10 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:10 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.445s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:42:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Deleted volume successfully. Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2c0f0ebd-138d-47c5-b5bb-0a495c8803b9 tempest-SnapshotsActionsTest-1828651929 None] Lock "cinder-a656ea46-0363-4f90-a134-97630dc62f7a-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Flow 'volume_create_manager' (9e4ec392-a2d5-446b-85b1-044087fd05cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820ff333-d8f8-49fd-9f4b-b9846cdc2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820ff333-d8f8-49fd-9f4b-b9846cdc2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1688618899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743ee482-7372-4701-ab9d-4cbd35e117bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c826f07b5764c98a6d3f6c064b949b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6e54ccea-7818-4e3f-98c2-8e07fbb4d31d,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:11Z,use_quota=True,user_id='c499e2c1e1a246c097893d49bae9a562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278e8702-10ba-427e-b882-b1d30a7640fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278e8702-10ba-427e-b882-b1d30a7640fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f36156c-ba72-47a3-8e94-d297b9d47791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f36156c-ba72-47a3-8e94-d297b9d47791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '743ee482-7372-4701-ab9d-4cbd35e117bf', 'volume_name': 'volume-743ee482-7372-4701-ab9d-4cbd35e117bf', 'volume_size': 2, 'source_volid': '6e54ccea-7818-4e3f-98c2-8e07fbb4d31d', 'source_volstatus': 'available'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87f73e-2c66-46b9-96ef-f78219aa6e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87f73e-2c66-46b9-96ef-f78219aa6e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503c8f5b-a3ba-4ea2-a9cb-a13bd677a1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Volume 743ee482-7372-4701-ab9d-4cbd35e117bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-743ee482-7372-4701-ab9d-4cbd35e117bf', 'volume_size': 2, 'source_volid': '6e54ccea-7818-4e3f-98c2-8e07fbb4d31d', 'source_volstatus': 'available'} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:10 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Cloning volume 6e54ccea-7818-4e3f-98c2-8e07fbb4d31d to volume 743ee482-7372-4701-ab9d-4cbd35e117bf Jul 22 20:42:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Creating offline snapshot c58765d5-c8f5-4957-b815-864dffaa790e of volume 6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:42:11 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3a83f-522a-4b7c-9b26-8c662a89054e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:11 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d Jul 22 20:42:11 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:11 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" returned: 0 in 0.559s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:11 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e 1G Jul 22 20:42:11 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:12 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e 1G" returned: 0 in 0.587s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:12 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e Jul 22 20:42:12 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:12 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e" returned: 0 in 0.406s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:12 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e is being set with open permissions: ugo+rw Jul 22 20:42:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:12 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e Jul 22 20:42:12 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:12 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e" returned: 0 in 0.380s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:13 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.info Jul 22 20:42:13 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:13 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.info" returned: 0 in 0.335s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:13 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.info is being set with open permissions: ugo+rw Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:13 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.info Jul 22 20:42:13 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:13 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.info" returned: 0 in 0.271s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Acquiring lock "cinder-quobyte-743ee482-7372-4701-ab9d-4cbd35e117bf" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-743ee482-7372-4701-ab9d-4cbd35e117bf" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] snapshot: c58765d5-c8f5-4957-b815-864dffaa790e, volume: 743ee482-7372-4701-ab9d-4cbd35e117bf, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4413c054-92c5-443b-a3d5-4f58a2dab356]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:13 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e Jul 22 20:42:13 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:14 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e" returned: 0 in 0.409s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[30384469-ea78-4abc-9217-f861f4f9b281]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:14 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d Jul 22 20:42:14 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:14 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" returned: 0 in 0.467s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:42:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:14 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf Jul 22 20:42:14 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Flow 'volume_create_manager' (cfc58a29-18cd-4826-aaa9-43190a173343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41808938-8c3c-4e6a-929c-cba97c6efa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41808938-8c3c-4e6a-929c-cba97c6efa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1072994713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5af81ef-017c-4f80-85df-38516145ff7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dba705a1d8d4d10b7d61f8daada4f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:19Z,use_quota=True,user_id='47ca50ac7a85497b97bbe39aaa1a041e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5b2491-abf5-4d57-af69-5258a6534a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5b2491-abf5-4d57-af69-5258a6534a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31185534-41be-4b48-88bc-354bd3aa6e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31185534-41be-4b48-88bc-354bd3aa6e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5af81ef-017c-4f80-85df-38516145ff7d', 'volume_name': 'volume-f5af81ef-017c-4f80-85df-38516145ff7d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d01e32-d4b0-4eed-acb9-7e0c8ff14ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d01e32-d4b0-4eed-acb9-7e0c8ff14ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce154093-ca90-463c-86ad-3ff4d8bb1641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:19 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Volume f5af81ef-017c-4f80-85df-38516145ff7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5af81ef-017c-4f80-85df-38516145ff7d', 'volume_size': 1} Jul 22 20:42:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:20 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf" returned: 0 in 6.200s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:20 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec240582-171a-4e1c-ab6f-a73903758c52]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:21 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d Jul 22 20:42:21 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:21 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" returned: 0 in 0.719s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:42:21 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Converted 1024.00 MB image at 165.13 MB/s Jul 22 20:42:21 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf is being set with open permissions: ugo+rw Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:21 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf Jul 22 20:42:21 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:21 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-743ee482-7372-4701-ab9d-4cbd35e117bf" released by "_copy_volume_from_snapshot" :: held 8.278s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Acquiring lock "cinder-quobyte-c58765d5-c8f5-4957-b815-864dffaa790e" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-c58765d5-c8f5-4957-b815-864dffaa790e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Deleting offline snapshot c58765d5-c8f5-4957-b815-864dffaa790e of volume 6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:42:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] snapshot_file for this snap is: volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:42:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8861efb6-912c-46a5-9bf7-694da65fd5ac]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:22 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e Jul 22 20:42:22 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:22 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e" returned: 0 in 0.505s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:42:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c17b794-03fa-40d4-9a27-705fbbb5fd32]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:22 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d Jul 22 20:42:22 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:23 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" returned: 0 in 0.493s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:23 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e Jul 22 20:42:23 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:23 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e" returned: 0 in 0.512s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:23 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e Jul 22 20:42:23 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:23 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d.c58765d5-c8f5-4957-b815-864dffaa790e" returned: 0 in 0.310s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-c58765d5-c8f5-4957-b815-864dffaa790e" released by "_delete_snapshot" :: held 1.991s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=123,cinder:UPDATE=144,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:42:23 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=130,cinder:SELECT=112,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.096s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.074s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1072994713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5af81ef-017c-4f80-85df-38516145ff7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dba705a1d8d4d10b7d61f8daada4f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:19Z,use_quota=True,user_id='47ca50ac7a85497b97bbe39aaa1a041e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Creating volume f5af81ef-017c-4f80-85df-38516145ff7d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:42:24 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:24 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d 1073741824 Jul 22 20:42:24 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503c8f5b-a3ba-4ea2-a9cb-a13bd677a1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743ee482-7372-4701-ab9d-4cbd35e117bf', 'volume_size': 2, 'source_volid': '6e54ccea-7818-4e3f-98c2-8e07fbb4d31d', 'source_volstatus': 'available'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b5d7d8-3e20-434c-86b0-26e6867bbd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:24 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Volume volume-743ee482-7372-4701-ab9d-4cbd35e117bf (743ee482-7372-4701-ab9d-4cbd35e117bf): created successfully Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b5d7d8-3e20-434c-86b0-26e6867bbd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Flow 'volume_create_manager' (9e4ec392-a2d5-446b-85b1-044087fd05cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-df6a9b3b-094c-41c2-a917-18ce68f4c426 tempest-VolumesCloneTest-626129712 None] Created volume successfully. Jul 22 20:42:24 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d 1073741824" returned: 0 in 0.587s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:24 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d Jul 22 20:42:24 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:25 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d" returned: 0 in 0.381s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce154093-ca90-463c-86ad-3ff4d8bb1641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5af81ef-017c-4f80-85df-38516145ff7d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63163b2c-a88d-409c-8e9f-5167383bdcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Volume volume-f5af81ef-017c-4f80-85df-38516145ff7d (f5af81ef-017c-4f80-85df-38516145ff7d): created successfully Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63163b2c-a88d-409c-8e9f-5167383bdcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Flow 'volume_create_manager' (cfc58a29-18cd-4826-aaa9-43190a173343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2f92a31b-323a-4975-bbe6-ea360a08a0a6 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Created volume successfully. Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Acquiring lock "cinder-743ee482-7372-4701-ab9d-4cbd35e117bf-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Lock "cinder-743ee482-7372-4701-ab9d-4cbd35e117bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Acquiring lock "cinder-quobyte-743ee482-7372-4701-ab9d-4cbd35e117bf" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-743ee482-7372-4701-ab9d-4cbd35e117bf" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ff06f-2259-42c5-b2af-644028bb6691]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:25 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf Jul 22 20:42:25 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:25 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf" returned: 0 in 0.422s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:26 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf Jul 22 20:42:26 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:26 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-743ee482-7372-4701-ab9d-4cbd35e117bf" returned: 0 in 0.363s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-743ee482-7372-4701-ab9d-4cbd35e117bf" released by "delete_volume" :: held 0.839s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Created reservations ['21a33188-fc8e-4c18-9b86-e6e55ec20d95', '0e8e5e23-dd98-425d-8ee3-f30a105f69a2', 'c328edc5-3d58-4222-9797-6186435c7fa4', '0be67d53-c304-48fa-8dd0-530d5e554847'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:26 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:42:26 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Acquiring lock "cinder-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Lock "cinder-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Acquiring lock "cinder-quobyte-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad401e3-60bc-465f-a1e4-f65622c985fe]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:27 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.490s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:42:27 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d Jul 22 20:42:27 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Deleted volume successfully. Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f7ffadb9-a5e7-47ec-87d6-c0ddda7ffd2a tempest-VolumesCloneTest-626129712 None] Lock "cinder-743ee482-7372-4701-ab9d-4cbd35e117bf-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Acquiring lock "cinder-f5af81ef-017c-4f80-85df-38516145ff7d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "cinder-f5af81ef-017c-4f80-85df-38516145ff7d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Acquiring lock "cinder-quobyte-f5af81ef-017c-4f80-85df-38516145ff7d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "cinder-quobyte-f5af81ef-017c-4f80-85df-38516145ff7d" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b4797-e292-4803-89ee-ddd4233fe698]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:27 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" returned: 0 in 0.571s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:27 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d Jul 22 20:42:27 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:27 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d Jul 22 20:42:27 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:27 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" returned: 0 in 0.314s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Lock "cinder-quobyte-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d" released by "delete_volume" :: held 0.950s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:27 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Created reservations ['e2c04b5b-2f19-4508-b75b-f5c975b09ba2', '4495c77f-a5f0-481a-b13a-8b0c64e132b9', 'e23d44e7-84bd-4ba6-a1d9-e44e7b91178c', 'fbf92d19-e45c-47aa-b3b2-9fbbcb6c8df2'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d" returned: 0 in 0.461s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:27 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d Jul 22 20:42:27 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:28 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:42:28 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:28 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5af81ef-017c-4f80-85df-38516145ff7d" returned: 0 in 0.360s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "cinder-quobyte-f5af81ef-017c-4f80-85df-38516145ff7d" released by "delete_volume" :: held 0.888s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:28 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.326s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:42:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Deleted volume successfully. Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Created reservations ['4f58eb02-2672-4f31-a23e-9170f12578c3', '4a5c9fca-7bdd-4280-869c-4dc079371ade', 'bac70135-af5b-4633-a475-133882b903f0', 'dac29a2c-b445-4efa-8f5f-5954f61c116a'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a2204069-9a49-4882-a7cf-e4c5b2f1a589 tempest-VolumesCloneTest-626129712 None] Lock "cinder-6e54ccea-7818-4e3f-98c2-8e07fbb4d31d-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:28 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:42:28 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-4ae4c45b-c31e-49f5-a61d-1c9b9d258dea req-5c3b2d0e-cd53-40a3-af1c-9586aa727c94 tempest-AttachVolumeNegativeTest-1912222297 None] Terminate volume connection completed successfully. Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-4ae4c45b-c31e-49f5-a61d-1c9b9d258dea req-5c3b2d0e-cd53-40a3-af1c-9586aa727c94 tempest-AttachVolumeNegativeTest-1912222297 None] Deleting attachment 5db0394c-67ff-47fd-8d0a-a95b534605aa. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:42:28 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.373s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:42:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Deleted volume successfully. Jul 22 20:42:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4da9a382-b24c-4800-8e08-2e0c48e23dc5 tempest-VolumeQuotasNegativeTestJSON-621225842 None] Lock "cinder-f5af81ef-017c-4f80-85df-38516145ff7d-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:42:38 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:DELETE=3,cinder:SELECT=16,cinder:INSERT=8,cinder:UPDATE=29 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:42:38 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:41 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:42:41 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:41 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:42:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Flow 'volume_create_manager' (6a84a36b-d0f2-4874-86ae-6ba0374cca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a01905-568a-4a76-8cfb-7910868f5986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a01905-568a-4a76-8cfb-7910868f5986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1233829234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3cc6ee-8e16-4405-a710-330f9b0f720b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e94c685aa44078aa007881d22b5589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:44Z,use_quota=True,user_id='0bfb279e70514180b0a471fa628aef7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9afe07-5af1-43b3-8f65-cf1e0776ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9afe07-5af1-43b3-8f65-cf1e0776ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5d4d7b-546f-49b3-91bf-ba1f9fd05df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5d4d7b-546f-49b3-91bf-ba1f9fd05df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c3cc6ee-8e16-4405-a710-330f9b0f720b', 'volume_name': 'volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134d333d-74cd-41f1-80cc-b58f0f798455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134d333d-74cd-41f1-80cc-b58f0f798455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e289e14-70a1-459e-a12d-e07932e09f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:44 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Volume 5c3cc6ee-8e16-4405-a710-330f9b0f720b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 20:42:44 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Trying to clone 5c3cc6ee-8e16-4405-a710-330f9b0f720b from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:42:45 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:42:45 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Image download 20.69 MB at 20.69 MB/s Jul 22 20:42:45 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[846acd6f-2f6b-456c-a315-02bbb25c5881]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:45 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD Jul 22 20:42:45 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:45 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:45 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 is fetched for user 0bfb279e70514180b0a471fa628aef7e. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:42:45 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[457e9b97-1048-4797-bc9d-49add7abd224]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:46 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD Jul 22 20:42:46 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:46 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1233829234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3cc6ee-8e16-4405-a710-330f9b0f720b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e94c685aa44078aa007881d22b5589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:44Z,use_quota=True,user_id='0bfb279e70514180b0a471fa628aef7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Creating volume 5c3cc6ee-8e16-4405-a710-330f9b0f720b {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:42:46 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:42:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:46 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b 1073741824 Jul 22 20:42:46 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:47 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b 1073741824" returned: 0 in 0.561s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:47 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b Jul 22 20:42:47 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:47 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b" returned: 0 in 0.289s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Attempting download of 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume 5c3cc6ee-8e16-4405-a710-330f9b0f720b. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b735c35-b990-47b4-83d0-0e1eaa6bac42]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_j19zev5v {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:47 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_j19zev5v Jul 22 20:42:47 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:47 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_j19zev5v" returned: 0 in 0.394s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_j19zev5v {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:48 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_j19zev5v Jul 22 20:42:48 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:48 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_j19zev5v" returned: 1 in 0.403s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_j19zev5v' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:42:48 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[133dbd13-613d-4d47-ac14-591519507299]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:42:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:48 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD Jul 22 20:42:48 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:48 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:48 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] 36543c2a-70aa-4e05-bb91-fc14ca93a149 was qcow2, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:42:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:48 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b Jul 22 20:42:48 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:51 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b" returned: 0 in 2.235s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_zyrq3z6jdevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:42:51 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Converted 112.00 MB image at 50.09 MB/s Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:51 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b 1G Jul 22 20:42:51 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:51 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b 1G" returned: 0 in 0.673s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Downloaded image 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume 5c3cc6ee-8e16-4405-a710-330f9b0f720b successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 for user 0bfb279e70514180b0a471fa628aef7e is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Marking volume 5c3cc6ee-8e16-4405-a710-330f9b0f720b as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Copying metadata from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 to 5c3cc6ee-8e16-4405-a710-330f9b0f720b. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Creating volume glance metadata for volume 5c3cc6ee-8e16-4405-a710-330f9b0f720b backed by image 36543c2a-70aa-4e05-bb91-fc14ca93a149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e289e14-70a1-459e-a12d-e07932e09f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9091444d-1ff7-4025-b169-c6b89a6a6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:51 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Volume volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b (5c3cc6ee-8e16-4405-a710-330f9b0f720b): created successfully Jul 22 20:42:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9091444d-1ff7-4025-b169-c6b89a6a6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Flow 'volume_create_manager' (6a84a36b-d0f2-4874-86ae-6ba0374cca56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-879fb51b-4a4c-466d-824f-bdf4f2b31166 tempest-TestShelveInstance-1658812540 None] Created volume successfully. Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Flow 'volume_create_manager' (16c941be-3513-407e-892e-153031a1fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3972302-adc6-4240-a6e0-75b85bd332a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3972302-adc6-4240-a6e0-75b85bd332a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-120156639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75c2c04-7eb2-494b-b216-252a33e27439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f3c4ebef445de946f4471d62f1987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:58Z,use_quota=True,user_id='9ba270d8220b4b8493118dd38e7024c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cb9496-698b-4bf0-8555-43e63cb03801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cb9496-698b-4bf0-8555-43e63cb03801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a776d2ff-a86a-49ea-a6bd-c22034601ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a776d2ff-a86a-49ea-a6bd-c22034601ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75c2c04-7eb2-494b-b216-252a33e27439', 'volume_name': 'volume-a75c2c04-7eb2-494b-b216-252a33e27439', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713a7964-3f1f-499e-8af7-60190aaf294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713a7964-3f1f-499e-8af7-60190aaf294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5910f0d1-c426-4e0b-8252-4fd621a11efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:57 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Volume a75c2c04-7eb2-494b-b216-252a33e27439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75c2c04-7eb2-494b-b216-252a33e27439', 'volume_size': 1} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-120156639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75c2c04-7eb2-494b-b216-252a33e27439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f3c4ebef445de946f4471d62f1987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:42:58Z,use_quota=True,user_id='9ba270d8220b4b8493118dd38e7024c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Creating volume a75c2c04-7eb2-494b-b216-252a33e27439 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:42:57 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:57 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 1073741824 Jul 22 20:42:57 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0d85acf1-f8c9-4ef8-95f8-b4da157fc630 req-162cb46f-5892-4cf0-aa1f-8b4160f5ab2b tempest-TestShelveInstance-1658812540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:42:58 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 1073741824" returned: 0 in 0.739s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:42:58 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 Jul 22 20:42:58 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:42:59 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439" returned: 0 in 0.494s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0d85acf1-f8c9-4ef8-95f8-b4da157fc630 req-162cb46f-5892-4cf0-aa1f-8b4160f5ab2b tempest-TestShelveInstance-1658812540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.216s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5910f0d1-c426-4e0b-8252-4fd621a11efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75c2c04-7eb2-494b-b216-252a33e27439', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96963476-9c05-458a-baf4-cd17b480bf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0d85acf1-f8c9-4ef8-95f8-b4da157fc630 req-162cb46f-5892-4cf0-aa1f-8b4160f5ab2b tempest-TestShelveInstance-1658812540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:42:59 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Volume volume-a75c2c04-7eb2-494b-b216-252a33e27439 (a75c2c04-7eb2-494b-b216-252a33e27439): created successfully Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96963476-9c05-458a-baf4-cd17b480bf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Flow 'volume_create_manager' (16c941be-3513-407e-892e-153031a1fa30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:42:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-10b921a0-c9e6-4304-82f6-f2c7d75e40ce tempest-VolumesListAdminTestJSON-85852858 None] Created volume successfully. Jul 22 20:42:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-0d85acf1-f8c9-4ef8-95f8-b4da157fc630 req-162cb46f-5892-4cf0-aa1f-8b4160f5ab2b tempest-TestShelveInstance-1658812540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2309d367-39c0-47d2-bcb4-f36dda464389', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:42:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-0d85acf1-f8c9-4ef8-95f8-b4da157fc630 req-162cb46f-5892-4cf0-aa1f-8b4160f5ab2b tempest-TestShelveInstance-1658812540 None] attachment_update completed successfully. Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Flow 'volume_create_manager' (281bc8b7-e567-405f-a424-d8ed263274f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2948e8a-58b8-4939-ae2d-8ca6f579cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2948e8a-58b8-4939-ae2d-8ca6f579cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-395792604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f3c4ebef445de946f4471d62f1987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:00Z,use_quota=True,user_id='9ba270d8220b4b8493118dd38e7024c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f063e3f7-8456-4746-97ac-b80544f547d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f063e3f7-8456-4746-97ac-b80544f547d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590830cc-673c-4484-b15f-c1c6993b633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590830cc-673c-4484-b15f-c1c6993b633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6', 'volume_name': 'volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4c29d7-b720-4a6c-a950-3d56ee60b95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4c29d7-b720-4a6c-a950-3d56ee60b95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01e2710-1a20-438d-a33b-280b2e2af42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:00 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Volume dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6', 'volume_size': 1} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-395792604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f3c4ebef445de946f4471d62f1987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:00Z,use_quota=True,user_id='9ba270d8220b4b8493118dd38e7024c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Creating volume dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:00 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:00 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 1073741824 Jul 22 20:43:00 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:01 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 1073741824" returned: 0 in 0.528s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:01 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 Jul 22 20:43:01 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:01 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6" returned: 0 in 0.311s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01e2710-1a20-438d-a33b-280b2e2af42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a1972-6856-4084-8788-a6f0920a6840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:01 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Volume volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 (dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6): created successfully Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a1972-6856-4084-8788-a6f0920a6840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Flow 'volume_create_manager' (281bc8b7-e567-405f-a424-d8ed263274f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:01 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3c6310f3-3683-4e42-a241-85172c91c095 tempest-VolumesListAdminTestJSON-85852858 None] Created volume successfully. Jul 22 20:43:03 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Flow 'volume_create_manager' (4389c8b1-ddee-46ea-b142-4cf4b9f6ae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42aaf4a6-2603-48bc-810b-68bfc91f2af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42aaf4a6-2603-48bc-810b-68bfc91f2af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-410069171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d95ce1-f309-4095-960e-3255c18ba0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f3c4ebef445de946f4471d62f1987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:04Z,use_quota=True,user_id='9ba270d8220b4b8493118dd38e7024c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942a6ba8-c137-4ec7-9f86-0ec6df4500a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942a6ba8-c137-4ec7-9f86-0ec6df4500a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4dbd2c-9440-4a60-a96f-cdca4ac4c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4dbd2c-9440-4a60-a96f-cdca4ac4c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d95ce1-f309-4095-960e-3255c18ba0f0', 'volume_name': 'volume-01d95ce1-f309-4095-960e-3255c18ba0f0', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e274d-a013-44ce-a105-31fabd288253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359e274d-a013-44ce-a105-31fabd288253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8428a6f7-4744-4115-8118-8063f2afa5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:04 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Volume 01d95ce1-f309-4095-960e-3255c18ba0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d95ce1-f309-4095-960e-3255c18ba0f0', 'volume_size': 1} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-410069171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d95ce1-f309-4095-960e-3255c18ba0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f3c4ebef445de946f4471d62f1987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:04Z,use_quota=True,user_id='9ba270d8220b4b8493118dd38e7024c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Creating volume 01d95ce1-f309-4095-960e-3255c18ba0f0 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:04 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:04 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 1073741824 Jul 22 20:43:04 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:05 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 1073741824" returned: 0 in 1.033s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:05 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 Jul 22 20:43:05 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:05 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0" returned: 0 in 0.550s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8428a6f7-4744-4115-8118-8063f2afa5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d95ce1-f309-4095-960e-3255c18ba0f0', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8968b6a3-060e-4ec1-89e4-256930f53999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Volume volume-01d95ce1-f309-4095-960e-3255c18ba0f0 (01d95ce1-f309-4095-960e-3255c18ba0f0): created successfully Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8968b6a3-060e-4ec1-89e4-256930f53999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Flow 'volume_create_manager' (4389c8b1-ddee-46ea-b142-4cf4b9f6ae4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-65ce09ee-9806-47c7-82b7-7a617e9834f9 tempest-VolumesListAdminTestJSON-85852858 None] Created volume successfully. Jul 22 20:43:07 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Flow 'volume_create_manager' (4a5c5c4d-b161-4a45-b51e-23fe593b873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee51a604-24a5-4625-a212-4652ef987ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee51a604-24a5-4625-a212-4652ef987ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376ad71a-2296-4b70-989b-740c792921a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f974303c7c494e872a0183663b4af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:08Z,use_quota=True,user_id='8af819aaf84a421d83c3f2a6a82633e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfaae02-5510-4d36-bfe3-e6a478fb3592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfaae02-5510-4d36-bfe3-e6a478fb3592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1563f24-d0a1-438c-88ef-f22928ddd820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1563f24-d0a1-438c-88ef-f22928ddd820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376ad71a-2296-4b70-989b-740c792921a4', 'volume_name': 'volume-376ad71a-2296-4b70-989b-740c792921a4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a96d14-3899-441f-b80e-aca5ca08ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a96d14-3899-441f-b80e-aca5ca08ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6653f5a4-0369-437c-b17f-bc857ad64fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Volume 376ad71a-2296-4b70-989b-740c792921a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376ad71a-2296-4b70-989b-740c792921a4', 'volume_size': 1} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376ad71a-2296-4b70-989b-740c792921a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f974303c7c494e872a0183663b4af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:08Z,use_quota=True,user_id='8af819aaf84a421d83c3f2a6a82633e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Creating volume 376ad71a-2296-4b70-989b-740c792921a4 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:08 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:08 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 1073741824 Jul 22 20:43:08 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:08 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 1073741824" returned: 0 in 0.905s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:09 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 Jul 22 20:43:09 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:09 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4" returned: 0 in 0.328s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6653f5a4-0369-437c-b17f-bc857ad64fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376ad71a-2296-4b70-989b-740c792921a4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ac662f-2f12-4fd9-b8f7-dfea642dc825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:09 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Volume volume-376ad71a-2296-4b70-989b-740c792921a4 (376ad71a-2296-4b70-989b-740c792921a4): created successfully Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ac662f-2f12-4fd9-b8f7-dfea642dc825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Flow 'volume_create_manager' (4a5c5c4d-b161-4a45-b51e-23fe593b873a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-87ba9003-5f22-46e4-a587-0b0ceb6ed2ef tempest-VolumesListAdminTestJSON-343004208 None] Created volume successfully. Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Flow 'volume_create_manager' (42c2c388-0cbb-466c-815b-55d930771eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc2471b-7b45-4636-a5c7-3ef6bc0302d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc2471b-7b45-4636-a5c7-3ef6bc0302d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1067723156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e59c15-57ef-478c-8805-fbd30ba3d861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040444cda94b4e958118f5518a6141c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:10Z,use_quota=True,user_id='1fd8ea96dbe24b6fabbce8b9c241f25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255c387f-288f-4590-98fc-8cb14d3dd6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255c387f-288f-4590-98fc-8cb14d3dd6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca1e085-7147-4353-b3c6-f1eaffc58607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca1e085-7147-4353-b3c6-f1eaffc58607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e59c15-57ef-478c-8805-fbd30ba3d861', 'volume_name': 'volume-c3e59c15-57ef-478c-8805-fbd30ba3d861', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d7d58b-8b33-4bec-b0b7-f89b75a4466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d7d58b-8b33-4bec-b0b7-f89b75a4466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e47bc7-9a35-4c0c-8287-4ba4c28aa894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Volume c3e59c15-57ef-478c-8805-fbd30ba3d861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e59c15-57ef-478c-8805-fbd30ba3d861', 'volume_size': 1} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1067723156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e59c15-57ef-478c-8805-fbd30ba3d861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040444cda94b4e958118f5518a6141c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:10Z,use_quota=True,user_id='1fd8ea96dbe24b6fabbce8b9c241f25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Creating volume c3e59c15-57ef-478c-8805-fbd30ba3d861 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:10 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Acquiring lock "cinder-376ad71a-2296-4b70-989b-740c792921a4-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:10 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 1073741824 Jul 22 20:43:10 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Lock "cinder-376ad71a-2296-4b70-989b-740c792921a4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Acquiring lock "cinder-quobyte-376ad71a-2296-4b70-989b-740c792921a4" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Lock "cinder-quobyte-376ad71a-2296-4b70-989b-740c792921a4" acquired by "delete_volume" :: waited 0.050s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8487f-08f1-4a2e-85cf-f750a9c81aaf]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "cinder-01d95ce1-f309-4095-960e-3255c18ba0f0-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-01d95ce1-f309-4095-960e-3255c18ba0f0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "cinder-quobyte-01d95ce1-f309-4095-960e-3255c18ba0f0" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:11 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 Jul 22 20:43:11 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-quobyte-01d95ce1-f309-4095-960e-3255c18ba0f0" acquired by "delete_volume" :: waited 0.051s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d9ad51-bc28-45cb-8f66-93a6ccd7ef75]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:11 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 Jul 22 20:43:11 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:11 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4" returned: 0 in 0.784s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:11 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 1073741824" returned: 0 in 1.200s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:11 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4 Jul 22 20:43:11 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:11 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 Jul 22 20:43:11 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Flow 'volume_create_manager' (65d15a2d-d128-4693-a6bc-633dd1f77c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3071c28-c07b-4f5a-9862-b9dba49ea655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3071c28-c07b-4f5a-9862-b9dba49ea655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1280578927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c1de12-cb26-4b51-ac3a-b8b657dec746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040444cda94b4e958118f5518a6141c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:12Z,use_quota=True,user_id='1fd8ea96dbe24b6fabbce8b9c241f25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:12 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12555f0d-19e3-4df0-b6eb-f310e44c9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12555f0d-19e3-4df0-b6eb-f310e44c9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cc7676-9cc5-4218-9c16-53b4e8e6d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cc7676-9cc5-4218-9c16-53b4e8e6d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c1de12-cb26-4b51-ac3a-b8b657dec746', 'volume_name': 'volume-86c1de12-cb26-4b51-ac3a-b8b657dec746', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a4ea0b-2236-4fe0-b875-3a99d22e2c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a4ea0b-2236-4fe0-b875-3a99d22e2c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f56b1-903f-4ba3-b5fd-a935030b24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Volume 86c1de12-cb26-4b51-ac3a-b8b657dec746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c1de12-cb26-4b51-ac3a-b8b657dec746', 'volume_size': 1} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0" returned: 0 in 0.994s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:12 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0 Jul 22 20:43:12 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:12 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861" returned: 0 in 0.608s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1280578927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c1de12-cb26-4b51-ac3a-b8b657dec746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040444cda94b4e958118f5518a6141c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:12Z,use_quota=True,user_id='1fd8ea96dbe24b6fabbce8b9c241f25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Creating volume 86c1de12-cb26-4b51-ac3a-b8b657dec746 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:12 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:12 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-376ad71a-2296-4b70-989b-740c792921a4" returned: 0 in 0.892s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:12 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 1073741824 Jul 22 20:43:12 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e47bc7-9a35-4c0c-8287-4ba4c28aa894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e59c15-57ef-478c-8805-fbd30ba3d861', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545b8746-42f4-446e-843c-7405ba7edb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Lock "cinder-quobyte-376ad71a-2296-4b70-989b-740c792921a4" released by "delete_volume" :: held 1.891s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Volume volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 (c3e59c15-57ef-478c-8805-fbd30ba3d861): created successfully Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545b8746-42f4-446e-843c-7405ba7edb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:12 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Flow 'volume_create_manager' (42c2c388-0cbb-466c-815b-55d930771eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-01d95ce1-f309-4095-960e-3255c18ba0f0" returned: 0 in 0.554s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-quobyte-01d95ce1-f309-4095-960e-3255c18ba0f0" released by "delete_volume" :: held 1.652s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-db1302b0-bcb9-4f9e-a6f8-540a2c61a779 tempest-TestServerVolumeAttachmentScenario-282139451 None] Created volume successfully. Jul 22 20:43:12 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Created reservations ['c3f85d37-6b59-4e36-b0cf-9a294673d47c', '745f3127-d6bf-417f-aae3-bf559b789c26', '7f184a2e-663e-42b1-8fe5-3aa639ee5238', 'a496fafe-c803-4ead-90fa-fdccf20c05bc'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Created reservations ['9aafeebb-6a28-4256-a31e-d36868d9f1f3', 'f85b2dc7-6781-43c9-8c71-cfd29722dd61', '7c812474-0464-400f-92d7-d613aa73c41d', 'e63df2f4-2894-4015-9415-92145670effb'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:13 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:43:13 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:13 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 1073741824" returned: 0 in 0.907s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:13 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:43:13 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:13 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 Jul 22 20:43:13 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "cinder-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:13 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.468s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:43:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Deleted volume successfully. Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "cinder-quobyte-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a92a8672-69b0-4168-b33d-cfc3e40a5d94 tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-01d95ce1-f309-4095-960e-3255c18ba0f0-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-quobyte-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6" acquired by "delete_volume" :: waited 0.053s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:13 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.768s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[746ccee4-b7b0-459a-810d-a4dd11e37952]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Deleted volume successfully. Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-86a5a095-020c-40df-aa8c-ea3aed620d9a tempest-VolumesListAdminTestJSON-343004208 None] Lock "cinder-376ad71a-2296-4b70-989b-740c792921a4-delete_volume" released by "delete_volume" :: held 3.550s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:14 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746" returned: 0 in 0.762s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:14 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 Jul 22 20:43:14 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f56b1-903f-4ba3-b5fd-a935030b24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c1de12-cb26-4b51-ac3a-b8b657dec746', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd86c725-ed3d-40a6-af3b-a60a993c1a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Volume volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 (86c1de12-cb26-4b51-ac3a-b8b657dec746): created successfully Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd86c725-ed3d-40a6-af3b-a60a993c1a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Flow 'volume_create_manager' (65d15a2d-d128-4693-a6bc-633dd1f77c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-96297164-c2e7-47e1-b47d-c5a22b12fb5a tempest-TestServerVolumeAttachmentScenario-282139451 None] Created volume successfully. Jul 22 20:43:14 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6" returned: 0 in 0.697s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:14 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6 Jul 22 20:43:14 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:15 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6" returned: 0 in 0.443s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-quobyte-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6" released by "delete_volume" :: held 1.225s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Created reservations ['3f73d20d-ba44-449e-a229-b5bb3db1c8f5', 'd1921e25-bbc1-44dc-ac4d-db6085b3a79b', '8c8c987e-cfaf-4f04-95f8-c7160f1f66dc', 'a0d7c005-3440-47dd-bb94-172e9704fab4'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:15 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:43:15 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:15 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.408s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:43:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Deleted volume successfully. Jul 22 20:43:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2834a5dd-8f7a-4547-9e6e-b24638d4a80f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-dfbf8a67-3696-4fd9-ad47-5c0a4a83f5a6-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "cinder-a75c2c04-7eb2-494b-b216-252a33e27439-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-a75c2c04-7eb2-494b-b216-252a33e27439-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "cinder-quobyte-a75c2c04-7eb2-494b-b216-252a33e27439" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-quobyte-a75c2c04-7eb2-494b-b216-252a33e27439" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d9f7f5-a24e-4fbe-b6c4-fd0c554d6b1b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:16 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 Jul 22 20:43:16 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:17 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439" returned: 0 in 0.693s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:17 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439 Jul 22 20:43:17 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Flow 'volume_create_manager' (768a8bd4-bb1f-4c13-87d3-b4265f9d1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e68a2b7-74e5-4263-9ebd-093fbfaf2fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e68a2b7-74e5-4263-9ebd-093fbfaf2fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1923307706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81356c6-12e6-4a63-a528-1019a8694735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2343bc3c891d4ecebfecdea9a40ff729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:17Z,use_quota=True,user_id='7fd7e9dc9011421aad59615a98726042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:17 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af87667-4b48-44c1-b2f4-b89eb44caf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af87667-4b48-44c1-b2f4-b89eb44caf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b23f0a-10b9-488f-bf6b-9a621f24a685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b23f0a-10b9-488f-bf6b-9a621f24a685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81356c6-12e6-4a63-a528-1019a8694735', 'volume_name': 'volume-b81356c6-12e6-4a63-a528-1019a8694735', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc45f4ea-ec53-435d-8909-f3ae96a82361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc45f4ea-ec53-435d-8909-f3ae96a82361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10499eb6-05b1-48e5-b850-e2f5e276d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:17 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Volume b81356c6-12e6-4a63-a528-1019a8694735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81356c6-12e6-4a63-a528-1019a8694735', 'volume_size': 1} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1923307706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81356c6-12e6-4a63-a528-1019a8694735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2343bc3c891d4ecebfecdea9a40ff729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:17Z,use_quota=True,user_id='7fd7e9dc9011421aad59615a98726042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Creating volume b81356c6-12e6-4a63-a528-1019a8694735 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:17 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a75c2c04-7eb2-494b-b216-252a33e27439" returned: 0 in 0.443s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-quobyte-a75c2c04-7eb2-494b-b216-252a33e27439" released by "delete_volume" :: held 1.209s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:17 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 1073741824 Jul 22 20:43:17 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Created reservations ['17c2e7f8-0d91-4455-bd44-a218268fdc19', '7ca34149-ec67-43d2-bffb-82fd53f8b738', '2dee1821-efd9-48d0-ab3b-f90794bcdc3f', '38f5592c-1971-4cd8-85c8-93c84a76a69e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:17 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:43:17 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:18 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.313s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:43:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Deleted volume successfully. Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-171fc716-1af5-482f-9d8f-2960ed89de0f tempest-VolumesListAdminTestJSON-85852858 None] Lock "cinder-a75c2c04-7eb2-494b-b216-252a33e27439-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:18 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 1073741824" returned: 0 in 0.631s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:18 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 Jul 22 20:43:18 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:18 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735" returned: 0 in 0.356s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10499eb6-05b1-48e5-b850-e2f5e276d07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81356c6-12e6-4a63-a528-1019a8694735', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099c500b-309a-4bc3-bbf9-ca9f3f8072b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:18 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Volume volume-b81356c6-12e6-4a63-a528-1019a8694735 (b81356c6-12e6-4a63-a528-1019a8694735): created successfully Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099c500b-309a-4bc3-bbf9-ca9f3f8072b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Flow 'volume_create_manager' (768a8bd4-bb1f-4c13-87d3-b4265f9d1674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-56824f85-7a99-4289-9eb4-b9e3371085bf tempest-AttachVolumeNegativeTest-1912222297 None] Created volume successfully. Jul 22 20:43:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6fd278cb-10c2-4807-9420-99e3b5f96e3a req-47b02e88-598a-4e8a-8535-103e8deaabd5 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6fd278cb-10c2-4807-9420-99e3b5f96e3a req-47b02e88-598a-4e8a-8535-103e8deaabd5 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6fd278cb-10c2-4807-9420-99e3b5f96e3a req-47b02e88-598a-4e8a-8535-103e8deaabd5 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-6fd278cb-10c2-4807-9420-99e3b5f96e3a req-47b02e88-598a-4e8a-8535-103e8deaabd5 tempest-AttachVolumeNegativeTest-1912222297 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-b81356c6-12e6-4a63-a528-1019a8694735', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b28c1c68-f7c6-48bd-a675-aec34e111c49', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:43:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-6fd278cb-10c2-4807-9420-99e3b5f96e3a req-47b02e88-598a-4e8a-8535-103e8deaabd5 tempest-AttachVolumeNegativeTest-1912222297 None] attachment_update completed successfully. Jul 22 20:43:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-aecfb0dc-54bc-4208-b6ed-87a47e35498a req-192cc8fb-5462-4285-a449-901867f1a58a tempest-AttachVolumeNegativeTest-1912222297 None] Terminate volume connection completed successfully. Jul 22 20:43:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-aecfb0dc-54bc-4208-b6ed-87a47e35498a req-192cc8fb-5462-4285-a449-901867f1a58a tempest-AttachVolumeNegativeTest-1912222297 None] Deleting attachment b28c1c68-f7c6-48bd-a675-aec34e111c49. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Flow 'volume_create_manager' (40269bb7-4c0b-4ba8-b77f-620b3d1d081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69affc1-c450-4a21-80d9-1cd3c667a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69affc1-c450-4a21-80d9-1cd3c667a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1100040004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79537a73-d195-4306-b357-566aaae56f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5f7b086b84254b516287d22a3a20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:27Z,use_quota=True,user_id='be2e4d11c10645e893a3afdc5ee83009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362358b-bb9d-4d80-a9b1-521e22f0e6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362358b-bb9d-4d80-a9b1-521e22f0e6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10430f22-c11b-43e6-af85-26e53b4af82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10430f22-c11b-43e6-af85-26e53b4af82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79537a73-d195-4306-b357-566aaae56f38', 'volume_name': 'volume-79537a73-d195-4306-b357-566aaae56f38', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b92c81-38e7-47b8-b05d-5a28c6d68312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b92c81-38e7-47b8-b05d-5a28c6d68312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4065f5-da38-4c64-9c05-5074fecb6f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:26 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Volume 79537a73-d195-4306-b357-566aaae56f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79537a73-d195-4306-b357-566aaae56f38', 'volume_size': 1} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1100040004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79537a73-d195-4306-b357-566aaae56f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5f7b086b84254b516287d22a3a20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:27Z,use_quota=True,user_id='be2e4d11c10645e893a3afdc5ee83009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Creating volume 79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:26 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:26 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 1073741824 Jul 22 20:43:26 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:27 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 1073741824" returned: 0 in 0.846s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:27 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 Jul 22 20:43:27 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:28 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38" returned: 0 in 0.380s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4065f5-da38-4c64-9c05-5074fecb6f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79537a73-d195-4306-b357-566aaae56f38', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9859f13-cd55-41c2-b73e-bc99ef6feca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Volume volume-79537a73-d195-4306-b357-566aaae56f38 (79537a73-d195-4306-b357-566aaae56f38): created successfully Jul 22 20:43:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9859f13-cd55-41c2-b73e-bc99ef6feca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Flow 'volume_create_manager' (40269bb7-4c0b-4ba8-b77f-620b3d1d081e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-253cd6c6-4cfb-42c4-b874-c2ae9065d453 tempest-SnapshotMetadataTestJSON-1341486733 None] Created volume successfully. Jul 22 20:43:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Creating offline snapshot cdb8f93f-8b79-42e7-b138-026b334bc84d of volume 79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:43:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed5cd5-5d1e-4ff1-9364-0c7394ab7a8c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:29 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 Jul 22 20:43:29 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:29 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38" returned: 0 in 0.542s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:29 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d 1G Jul 22 20:43:29 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:30 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d 1G" returned: 0 in 0.564s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79537a73-d195-4306-b357-566aaae56f38 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:30 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79537a73-d195-4306-b357-566aaae56f38 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d Jul 22 20:43:30 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:30 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79537a73-d195-4306-b357-566aaae56f38 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d" returned: 0 in 0.294s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:30 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d is being set with open permissions: ugo+rw Jul 22 20:43:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:30 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d Jul 22 20:43:30 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:31 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d" returned: 0 in 0.313s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:31 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.info Jul 22 20:43:31 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:31 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.info" returned: 0 in 0.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:31 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.info is being set with open permissions: ugo+rw Jul 22 20:43:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:31 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.info Jul 22 20:43:31 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:31 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.info" returned: 0 in 0.310s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bea95791-87be-4aa4-8385-6188e17d0b0a tempest-SnapshotMetadataTestJSON-1341486733 None] Create snapshot completed successfully Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "cinder-cdb8f93f-8b79-42e7-b138-026b334bc84d-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-cdb8f93f-8b79-42e7-b138-026b334bc84d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "cinder-quobyte-79537a73-d195-4306-b357-566aaae56f38" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-quobyte-79537a73-d195-4306-b357-566aaae56f38" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "cinder-quobyte-cdb8f93f-8b79-42e7-b138-026b334bc84d" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-quobyte-cdb8f93f-8b79-42e7-b138-026b334bc84d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Deleting offline snapshot cdb8f93f-8b79-42e7-b138-026b334bc84d of volume 79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] snapshot_file for this snap is: volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[271fa626-76ef-4e32-be62-7b34309e8d59]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:33 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d Jul 22 20:43:33 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:34 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d" returned: 0 in 0.543s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79537a73-d195-4306-b357-566aaae56f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:43:34 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3670c23-ef4f-48ba-83c2-793787e24605]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:34 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 Jul 22 20:43:34 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:34 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38" returned: 0 in 0.462s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:34 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d Jul 22 20:43:34 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:35 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d" returned: 0 in 0.391s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:35 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d Jul 22 20:43:35 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:35 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38.cdb8f93f-8b79-42e7-b138-026b334bc84d" returned: 0 in 0.388s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-quobyte-cdb8f93f-8b79-42e7-b138-026b334bc84d" released by "_delete_snapshot" :: held 1.929s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-quobyte-79537a73-d195-4306-b357-566aaae56f38" released by "delete_snapshot" :: held 1.970s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:35 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Created reservations ['cbd81756-bcab-4c18-b995-224528600730', 'f0c21d43-b7cc-4ed7-9f5a-3cb9ee9e3eaf', 'b4a5f7ff-d5a2-4384-9a74-7620702b978c', 'd76b2a40-733b-45c4-8610-693626bd4eaa'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:43:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Delete snapshot completed successfully. Jul 22 20:43:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76346634-ecf8-4416-a5c3-e27c3e72dfce tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-cdb8f93f-8b79-42e7-b138-026b334bc84d-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "cinder-79537a73-d195-4306-b357-566aaae56f38-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-79537a73-d195-4306-b357-566aaae56f38-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "cinder-quobyte-79537a73-d195-4306-b357-566aaae56f38" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-quobyte-79537a73-d195-4306-b357-566aaae56f38" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:37 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d5bdc-ffe4-4bfc-b1d9-c2968883731c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:37 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 Jul 22 20:43:37 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:37 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38" returned: 0 in 0.564s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:37 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38 Jul 22 20:43:37 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:38 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79537a73-d195-4306-b357-566aaae56f38" returned: 0 in 0.553s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-quobyte-79537a73-d195-4306-b357-566aaae56f38" released by "delete_volume" :: held 1.200s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Created reservations ['244cab01-1aa5-45db-9ba7-73eb925890d6', '1c55bc30-3a0e-44e8-8176-1caa8f765d18', '6224655f-5838-495b-8534-6bcd79ddfb4d', 'fb251fee-b651-48ed-bc9b-2b93dd32af63'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:38 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:43:38 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:38 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.298s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:43:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Deleted volume successfully. Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=78,cinder:SELECT=74,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:43:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9973235-f0b0-4da4-8149-8c67d7df6be6 tempest-SnapshotMetadataTestJSON-1341486733 None] Lock "cinder-79537a73-d195-4306-b357-566aaae56f38-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:41 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:43:41 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:41 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.583s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:43:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:43:43 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=74,cinder:INSERT=21,cinder:UPDATE=79,cinder:DELETE=7 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:43:43 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-043a3110-e222-4c24-ae97-930c38caf842 req-c3f15910-22c9-41f8-bd5b-0391e3245761 tempest-TestShelveInstance-1658812540 None] Terminate volume connection completed successfully. Jul 22 20:43:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-043a3110-e222-4c24-ae97-930c38caf842 req-c3f15910-22c9-41f8-bd5b-0391e3245761 tempest-TestShelveInstance-1658812540 None] Deleting attachment 2309d367-39c0-47d2-bcb4-f36dda464389. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Flow 'volume_create_manager' (e05419c0-81ef-49ef-97dc-d8a4482a3ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dded9a-ab55-4d7f-ae66-a5295f2dc6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dded9a-ab55-4d7f-ae66-a5295f2dc6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1111313761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a60e60-6126-4126-94ca-437a30662ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c7bbc123c64454af3edd40cfce5a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:46Z,use_quota=True,user_id='4b398a32620d4f7599d89bb7f9fa73aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f86bfd-5ea7-4fc4-8556-c8b083402d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f86bfd-5ea7-4fc4-8556-c8b083402d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d5e9fa-eda3-40d3-910d-9257981873a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d5e9fa-eda3-40d3-910d-9257981873a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a60e60-6126-4126-94ca-437a30662ac7', 'volume_name': 'volume-51a60e60-6126-4126-94ca-437a30662ac7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6904d8-46e9-42df-b958-a9c58b5445c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6904d8-46e9-42df-b958-a9c58b5445c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9be15d-cc44-4937-b571-81595cfe6fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:45 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Volume 51a60e60-6126-4126-94ca-437a30662ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a60e60-6126-4126-94ca-437a30662ac7', 'volume_size': 1} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1111313761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a60e60-6126-4126-94ca-437a30662ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c7bbc123c64454af3edd40cfce5a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:43:46Z,use_quota=True,user_id='4b398a32620d4f7599d89bb7f9fa73aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Creating volume 51a60e60-6126-4126-94ca-437a30662ac7 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:43:45 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:43:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:45 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 1073741824 Jul 22 20:43:45 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:46 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 1073741824" returned: 0 in 1.020s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-c040020e-db7c-4ad9-98d2-d26ddadb22ed req-433b42bf-d936-44f3-ae20-e982e4b15536 tempest-TestShelveInstance-1658812540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:46 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 Jul 22 20:43:46 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:47 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7" returned: 0 in 0.337s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-c040020e-db7c-4ad9-98d2-d26ddadb22ed req-433b42bf-d936-44f3-ae20-e982e4b15536 tempest-TestShelveInstance-1658812540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.285s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9be15d-cc44-4937-b571-81595cfe6fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a60e60-6126-4126-94ca-437a30662ac7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34555a96-0235-48ec-bee0-e36f92ecb78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-c040020e-db7c-4ad9-98d2-d26ddadb22ed req-433b42bf-d936-44f3-ae20-e982e4b15536 tempest-TestShelveInstance-1658812540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:47 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Volume volume-51a60e60-6126-4126-94ca-437a30662ac7 (51a60e60-6126-4126-94ca-437a30662ac7): created successfully Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34555a96-0235-48ec-bee0-e36f92ecb78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Flow 'volume_create_manager' (e05419c0-81ef-49ef-97dc-d8a4482a3ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:43:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-36c51c06-03df-401d-916a-c208d2b75892 tempest-AbsoluteLimitsTests-1060308168 None] Created volume successfully. Jul 22 20:43:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-c040020e-db7c-4ad9-98d2-d26ddadb22ed req-433b42bf-d936-44f3-ae20-e982e4b15536 tempest-TestShelveInstance-1658812540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db74e797-0ec1-49fc-9bc5-a471f91401b6', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:43:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-c040020e-db7c-4ad9-98d2-d26ddadb22ed req-433b42bf-d936-44f3-ae20-e982e4b15536 tempest-TestShelveInstance-1658812540 None] attachment_update completed successfully. Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Acquiring lock "cinder-51a60e60-6126-4126-94ca-437a30662ac7-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Lock "cinder-51a60e60-6126-4126-94ca-437a30662ac7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Acquiring lock "cinder-quobyte-51a60e60-6126-4126-94ca-437a30662ac7" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Lock "cinder-quobyte-51a60e60-6126-4126-94ca-437a30662ac7" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2edb0ac-c69c-4101-b3a7-e8eafc2b91fa]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:48 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 Jul 22 20:43:48 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:48 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7" returned: 0 in 0.444s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:48 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7 Jul 22 20:43:48 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:48 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-51a60e60-6126-4126-94ca-437a30662ac7" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Lock "cinder-quobyte-51a60e60-6126-4126-94ca-437a30662ac7" released by "delete_volume" :: held 0.798s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Created reservations ['974d284b-63cb-45ca-8de0-dabd5f463f9c', '0c5ac944-793c-4d94-8a1d-5e7d2ba361b7', '6d22fd4a-082e-4b38-b8a5-279195460768', '8e985e3c-e1c1-41c3-9c5c-323c3f761aef'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:43:49 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:43:49 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:43:49 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.485s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:43:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Deleted volume successfully. Jul 22 20:43:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-23926811-5cb2-48c0-9242-979a44e944d1 tempest-AbsoluteLimitsTests-1060308168 None] Lock "cinder-51a60e60-6126-4126-94ca-437a30662ac7-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:43:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-e21bb8d9-244e-411b-9c7b-cbcc4957bd87 req-eb625a04-0afd-4e81-9dc5-92529d772a1b tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-e21bb8d9-244e-411b-9c7b-cbcc4957bd87 req-eb625a04-0afd-4e81-9dc5-92529d772a1b tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-e21bb8d9-244e-411b-9c7b-cbcc4957bd87 req-eb625a04-0afd-4e81-9dc5-92529d772a1b tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-e21bb8d9-244e-411b-9c7b-cbcc4957bd87 req-eb625a04-0afd-4e81-9dc5-92529d772a1b tempest-TestServerVolumeAttachmentScenario-282139451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-c3e59c15-57ef-478c-8805-fbd30ba3d861', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92da9426-3985-4d91-af12-ef67a336854f', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:43:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-e21bb8d9-244e-411b-9c7b-cbcc4957bd87 req-eb625a04-0afd-4e81-9dc5-92529d772a1b tempest-TestServerVolumeAttachmentScenario-282139451 None] attachment_update completed successfully. Jul 22 20:43:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-ce173d12-e8a5-455a-8835-f101c58d330b req-6981fda8-5d0e-452f-bbdd-815132cad867 tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:43:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-ce173d12-e8a5-455a-8835-f101c58d330b req-6981fda8-5d0e-452f-bbdd-815132cad867 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:43:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-ce173d12-e8a5-455a-8835-f101c58d330b req-6981fda8-5d0e-452f-bbdd-815132cad867 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:43:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-ce173d12-e8a5-455a-8835-f101c58d330b req-6981fda8-5d0e-452f-bbdd-815132cad867 tempest-TestServerVolumeAttachmentScenario-282139451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-86c1de12-cb26-4b51-ac3a-b8b657dec746', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed2f2fae-085b-4fde-9ba1-9908ef759d2d', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:43:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-ce173d12-e8a5-455a-8835-f101c58d330b req-6981fda8-5d0e-452f-bbdd-815132cad867 tempest-TestServerVolumeAttachmentScenario-282139451 None] attachment_update completed successfully. Jul 22 20:44:01 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-def7d21f-85f8-4b61-bf25-390ef1e7417c req-33d025c0-33cd-438e-9e9d-0b7f6e7d9904 tempest-TestServerVolumeAttachmentScenario-282139451 None] Terminate volume connection completed successfully. Jul 22 20:44:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-def7d21f-85f8-4b61-bf25-390ef1e7417c req-33d025c0-33cd-438e-9e9d-0b7f6e7d9904 tempest-TestServerVolumeAttachmentScenario-282139451 None] Deleting attachment ed2f2fae-085b-4fde-9ba1-9908ef759d2d. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:44:03 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-9721fbfd-df82-49f6-8a83-30f2f8addb15 req-54c3cd47-5f63-4ffc-a415-5cd7e5381504 tempest-TestServerVolumeAttachmentScenario-282139451 None] Terminate volume connection completed successfully. Jul 22 20:44:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9721fbfd-df82-49f6-8a83-30f2f8addb15 req-54c3cd47-5f63-4ffc-a415-5cd7e5381504 tempest-TestServerVolumeAttachmentScenario-282139451 None] Deleting attachment 92da9426-3985-4d91-af12-ef67a336854f. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Flow 'volume_create_manager' (cea81f00-de8a-46b1-a9e4-8cc9cdce4435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce9289a-7a14-4ef2-8b70-b46d0022d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce9289a-7a14-4ef2-8b70-b46d0022d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839688357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990a91a4-01fa-49a6-9c2f-de51d4c1eee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd864a47e472419baace6cd1293d6844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:08Z,use_quota=True,user_id='15a6920192184cc99a8a352b08c69426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a268dde2-b5e9-432a-a70a-116faeff7db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a268dde2-b5e9-432a-a70a-116faeff7db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3173a28b-9a32-4bbb-8beb-308af9b7a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3173a28b-9a32-4bbb-8beb-308af9b7a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990a91a4-01fa-49a6-9c2f-de51d4c1eee3', 'volume_name': 'volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a668b7b1-aefe-4b2f-93d6-49ffaa4955f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a668b7b1-aefe-4b2f-93d6-49ffaa4955f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca4978c-c190-426f-bfe4-e3e323dab530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Volume 990a91a4-01fa-49a6-9c2f-de51d4c1eee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3', 'volume_size': 1} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839688357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990a91a4-01fa-49a6-9c2f-de51d4c1eee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd864a47e472419baace6cd1293d6844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:08Z,use_quota=True,user_id='15a6920192184cc99a8a352b08c69426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Creating volume 990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:44:08 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Flow 'volume_create_manager' (5443da90-37ca-4a5c-a287-61ad71e2f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:08 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 1073741824 Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9927a44-8ef0-4a97-bbf4-6f0002e94bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9927a44-8ef0-4a97-bbf4-6f0002e94bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-149299157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44862854-baef-458b-9124-481ab176ee9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2343bc3c891d4ecebfecdea9a40ff729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:08Z,use_quota=True,user_id='7fd7e9dc9011421aad59615a98726042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5906cc0-bf83-4d71-9629-08944a120359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5906cc0-bf83-4d71-9629-08944a120359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b80da6-d6f7-414f-9b72-facd637e1d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b80da6-d6f7-414f-9b72-facd637e1d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44862854-baef-458b-9124-481ab176ee9a', 'volume_name': 'volume-44862854-baef-458b-9124-481ab176ee9a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b3903f-fa9f-457a-b7a8-55cded02de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b3903f-fa9f-457a-b7a8-55cded02de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9d156f-dc3e-43d5-934d-227deb955ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Volume 44862854-baef-458b-9124-481ab176ee9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44862854-baef-458b-9124-481ab176ee9a', 'volume_size': 1} Jul 22 20:44:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:09 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 1073741824" returned: 0 in 0.636s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:09 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:44:09 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:09 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.293s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-149299157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44862854-baef-458b-9124-481ab176ee9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2343bc3c891d4ecebfecdea9a40ff729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:08Z,use_quota=True,user_id='7fd7e9dc9011421aad59615a98726042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Creating volume 44862854-baef-458b-9124-481ab176ee9a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:44:09 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca4978c-c190-426f-bfe4-e3e323dab530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:09 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a 1073741824 Jul 22 20:44:09 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d1585e-2e68-4f91-b60a-807a36fd523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:09 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Volume volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 (990a91a4-01fa-49a6-9c2f-de51d4c1eee3): created successfully Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d1585e-2e68-4f91-b60a-807a36fd523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Flow 'volume_create_manager' (cea81f00-de8a-46b1-a9e4-8cc9cdce4435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-52ad2026-0973-4540-9a32-7f1b8acefbe1 tempest-VolumesActionsTest-1724702486 None] Created volume successfully. Jul 22 20:44:10 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a 1073741824" returned: 0 in 0.623s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:10 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a Jul 22 20:44:10 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:10 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a" returned: 0 in 0.296s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9d156f-dc3e-43d5-934d-227deb955ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44862854-baef-458b-9124-481ab176ee9a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6a852e-f443-4c7e-899c-bbf30b4a6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Volume volume-44862854-baef-458b-9124-481ab176ee9a (44862854-baef-458b-9124-481ab176ee9a): created successfully Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6a852e-f443-4c7e-899c-bbf30b4a6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Flow 'volume_create_manager' (5443da90-37ca-4a5c-a287-61ad71e2f520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-70e6d6e1-6adf-4df7-9040-fce4173e0d38 tempest-AttachVolumeNegativeTest-1912222297 None] Created volume successfully. Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "cinder-86c1de12-cb26-4b51-ac3a-b8b657dec746-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-86c1de12-cb26-4b51-ac3a-b8b657dec746-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "cinder-quobyte-86c1de12-cb26-4b51-ac3a-b8b657dec746" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-quobyte-86c1de12-cb26-4b51-ac3a-b8b657dec746" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb3e54f-8fe8-453c-91ed-cbde1bbdb397]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:11 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 Jul 22 20:44:11 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:11 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746" returned: 0 in 0.401s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:11 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746 Jul 22 20:44:11 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:11 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86c1de12-cb26-4b51-ac3a-b8b657dec746" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-quobyte-86c1de12-cb26-4b51-ac3a-b8b657dec746" released by "delete_volume" :: held 0.712s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Created reservations ['12b4f5c6-911a-4a9f-b0b4-668c0e9dbe5b', '01dad624-9ac4-44dc-a81c-c2774c91c2bb', 'c8efaeb7-5352-47be-9622-794bd390145c', '99821df9-7350-4d95-9858-74bfebf14927'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:11 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:11 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0862207c-eadd-49b5-aa81-d1c57968a103 req-2141046c-aaf1-4c7e-b41d-c3948ef6afb9 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0862207c-eadd-49b5-aa81-d1c57968a103 req-2141046c-aaf1-4c7e-b41d-c3948ef6afb9 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-0862207c-eadd-49b5-aa81-d1c57968a103 req-2141046c-aaf1-4c7e-b41d-c3948ef6afb9 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "cinder-c3e59c15-57ef-478c-8805-fbd30ba3d861-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-0862207c-eadd-49b5-aa81-d1c57968a103 req-2141046c-aaf1-4c7e-b41d-c3948ef6afb9 tempest-AttachVolumeNegativeTest-1912222297 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-44862854-baef-458b-9124-481ab176ee9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edaa12f1-4989-4a38-85ac-1c85e862fc40', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:44:12 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.326s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-c3e59c15-57ef-478c-8805-fbd30ba3d861-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Deleted volume successfully. Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2d086187-efdb-4d05-9cef-ac90ba3f5323 tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-86c1de12-cb26-4b51-ac3a-b8b657dec746-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "cinder-quobyte-c3e59c15-57ef-478c-8805-fbd30ba3d861" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-0862207c-eadd-49b5-aa81-d1c57968a103 req-2141046c-aaf1-4c7e-b41d-c3948ef6afb9 tempest-AttachVolumeNegativeTest-1912222297 None] attachment_update completed successfully. Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-quobyte-c3e59c15-57ef-478c-8805-fbd30ba3d861" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f9e02-e9f0-4213-9755-2cb3b977c4a1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:12 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 Jul 22 20:44:12 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:12 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861" returned: 0 in 0.440s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:12 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861 Jul 22 20:44:12 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:12 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c3e59c15-57ef-478c-8805-fbd30ba3d861" returned: 0 in 0.347s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-quobyte-c3e59c15-57ef-478c-8805-fbd30ba3d861" released by "delete_volume" :: held 0.852s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Created reservations ['67324c4a-3b0f-4a72-b4b5-b4052b9b22f0', '1c1bc8cc-bcb6-41e9-b9ff-a1797a780dfa', '166bc7bf-96a0-429f-807a-6e560d7c44de', '68b57cb0-4244-446d-b043-5097c60e9f3d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:13 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:13 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:13 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.478s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Deleted volume successfully. Jul 22 20:44:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90324936-c2de-4233-94c2-bf0c9e56c00a tempest-TestServerVolumeAttachmentScenario-282139451 None] Lock "cinder-c3e59c15-57ef-478c-8805-fbd30ba3d861-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-37c2f8b8-c7ba-47a5-9260-3ed4e5189faf req-b5638f59-bbad-4b96-bf13-f8b23b097e07 tempest-AttachVolumeNegativeTest-1912222297 None] Terminate volume connection completed successfully. Jul 22 20:44:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-37c2f8b8-c7ba-47a5-9260-3ed4e5189faf req-b5638f59-bbad-4b96-bf13-f8b23b097e07 tempest-AttachVolumeNegativeTest-1912222297 None] Deleting attachment edaa12f1-4989-4a38-85ac-1c85e862fc40. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:44:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "cinder-44862854-baef-458b-9124-481ab176ee9a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-44862854-baef-458b-9124-481ab176ee9a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "cinder-quobyte-44862854-baef-458b-9124-481ab176ee9a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-quobyte-44862854-baef-458b-9124-481ab176ee9a" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:20 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9db163-f2ea-4294-a09d-1c4f175c7058]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:21 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a Jul 22 20:44:21 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:21 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a" returned: 0 in 0.450s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:21 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a Jul 22 20:44:21 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-09471433-7bc9-4450-9822-076051738d43 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" by "attach_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-09471433-7bc9-4450-9822-076051738d43 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" acquired by "attach_volume" :: waited 0.039s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-09471433-7bc9-4450-9822-076051738d43 tempest-VolumesActionsTest-1724702486 None] Attaching volume 990a91a4-01fa-49a6-9c2f-de51d4c1eee3 to instance 01450f27-2cd0-41d2-b687-be617a7d55ea at mountpoint /dev/vdb on host None. Jul 22 20:44:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-09471433-7bc9-4450-9822-076051738d43 tempest-VolumesActionsTest-1724702486 None] Attach volume completed successfully. Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-09471433-7bc9-4450-9822-076051738d43 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" released by "attach_volume" :: held 0.199s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:21 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-44862854-baef-458b-9124-481ab176ee9a" returned: 0 in 0.460s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-quobyte-44862854-baef-458b-9124-481ab176ee9a" released by "delete_volume" :: held 0.981s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:21 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Created reservations ['82a2e984-15ad-4170-bc69-c276b9231107', 'd8104da0-7487-4219-a22f-f5c584615707', '6cd6aa8f-ccf2-451f-9f54-fe221277daf2', 'e6cd3a52-67b3-4123-9dd9-29a9140da2b9'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cf3b5f6c-dc43-4ada-ae80-4952bea43c66 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-detach_volume" by "detach_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:22 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:22 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cf3b5f6c-dc43-4ada-ae80-4952bea43c66 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cf3b5f6c-dc43-4ada-ae80-4952bea43c66 tempest-VolumesActionsTest-1724702486 None] Detaching volume 990a91a4-01fa-49a6-9c2f-de51d4c1eee3 from instance 01450f27-2cd0-41d2-b687-be617a7d55ea. Jul 22 20:44:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cf3b5f6c-dc43-4ada-ae80-4952bea43c66 tempest-VolumesActionsTest-1724702486 None] Detach volume completed successfully. Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cf3b5f6c-dc43-4ada-ae80-4952bea43c66 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-detach_volume" released by "detach_volume" :: held 0.166s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "cinder-b81356c6-12e6-4a63-a528-1019a8694735-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-b81356c6-12e6-4a63-a528-1019a8694735-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "cinder-quobyte-b81356c6-12e6-4a63-a528-1019a8694735" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-quobyte-b81356c6-12e6-4a63-a528-1019a8694735" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e4b9d9-6ded-4c2d-852a-6d0d7e2f4eb9]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:22 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.491s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Deleted volume successfully. Jul 22 20:44:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dca3bab8-30a0-4338-bd62-357186283c0b tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-44862854-baef-458b-9124-481ab176ee9a-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:22 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 Jul 22 20:44:22 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:23 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735" returned: 0 in 0.586s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:23 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735 Jul 22 20:44:23 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:23 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b81356c6-12e6-4a63-a528-1019a8694735" returned: 0 in 0.634s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-quobyte-b81356c6-12e6-4a63-a528-1019a8694735" released by "delete_volume" :: held 1.299s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Created reservations ['5fe39f28-9963-420f-b55b-6a01dce0d862', '1e28f8a8-ee45-44d4-bf36-204db85ba580', '750f8179-6246-4319-9a3e-c7b080ca6859', 'cea640e3-db0d-4973-89b5-67c145ac9a4d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:23 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:23 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:24 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.372s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:24 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Deleted volume successfully. Jul 22 20:44:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9f4a4cd6-9a1f-405a-899b-7fc149876389 tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-b81356c6-12e6-4a63-a528-1019a8694735-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "cinder-6fed262b-4a80-42c9-8a46-2edceed57c57-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-6fed262b-4a80-42c9-8a46-2edceed57c57-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "cinder-quobyte-6fed262b-4a80-42c9-8a46-2edceed57c57" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-quobyte-6fed262b-4a80-42c9-8a46-2edceed57c57" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[82581e12-576c-423c-ab36-b111caad0964]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:25 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 Jul 22 20:44:25 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:25 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57" returned: 0 in 0.462s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:25 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57 Jul 22 20:44:25 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:25 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6fed262b-4a80-42c9-8a46-2edceed57c57" returned: 0 in 0.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-quobyte-6fed262b-4a80-42c9-8a46-2edceed57c57" released by "delete_volume" :: held 0.795s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Created reservations ['b389d916-a070-4bd3-bb90-6330b1474482', '222185e1-f034-4cdb-9b3a-37ff4db76871', '37480489-5350-496a-bfe8-955750638ef1', 'cc731c11-39f5-416a-b92c-7eec8c16108d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:26 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:26 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:26 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.354s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:26 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Deleted volume successfully. Jul 22 20:44:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-15920db1-3258-4622-acfb-0f753259732d tempest-AttachVolumeNegativeTest-1912222297 None] Lock "cinder-6fed262b-4a80-42c9-8a46-2edceed57c57-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d3a24c6-e1b7-40c8-a94e-461fae99c94c tempest-VolumesActionsTest-1724702486 None] Acquiring lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" by "attach_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d3a24c6-e1b7-40c8-a94e-461fae99c94c tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" acquired by "attach_volume" :: waited 0.061s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:36 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=69,cinder:UPDATE=59,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:44:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3d3a24c6-e1b7-40c8-a94e-461fae99c94c tempest-VolumesActionsTest-1724702486 None] Attaching volume 990a91a4-01fa-49a6-9c2f-de51d4c1eee3 to instance 13c561ee-6e2a-4079-9cbc-ad0ccdc560c2 at mountpoint /dev/vdb on host None. Jul 22 20:44:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3d3a24c6-e1b7-40c8-a94e-461fae99c94c tempest-VolumesActionsTest-1724702486 None] Attach volume completed successfully. Jul 22 20:44:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d3a24c6-e1b7-40c8-a94e-461fae99c94c tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" released by "attach_volume" :: held 0.230s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11cdfc52-504d-4605-a88a-cf807fce7d97 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-detach_volume" by "detach_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11cdfc52-504d-4605-a88a-cf807fce7d97 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-11cdfc52-504d-4605-a88a-cf807fce7d97 tempest-VolumesActionsTest-1724702486 None] Detaching volume 990a91a4-01fa-49a6-9c2f-de51d4c1eee3 from instance 13c561ee-6e2a-4079-9cbc-ad0ccdc560c2. Jul 22 20:44:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-11cdfc52-504d-4605-a88a-cf807fce7d97 tempest-VolumesActionsTest-1724702486 None] Detach volume completed successfully. Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11cdfc52-504d-4605-a88a-cf807fce7d97 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-detach_volume" released by "detach_volume" :: held 0.182s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-9bb2a870-4b37-47e8-8f40-91f50913c9cb tempest-TestShelveInstance-1658812540 None] Terminate volume connection completed successfully. Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-9bb2a870-4b37-47e8-8f40-91f50913c9cb tempest-TestShelveInstance-1658812540 None] Deleting attachment db74e797-0ec1-49fc-9bc5-a471f91401b6. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Acquiring lock "cinder-5c3cc6ee-8e16-4405-a710-330f9b0f720b-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Lock "cinder-5c3cc6ee-8e16-4405-a710-330f9b0f720b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Acquiring lock "cinder-quobyte-5c3cc6ee-8e16-4405-a710-330f9b0f720b" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Lock "cinder-quobyte-5c3cc6ee-8e16-4405-a710-330f9b0f720b" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b992738-32db-4a07-8ae4-67d6661cfe0e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:38 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b Jul 22 20:44:38 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:38 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b" returned: 0 in 0.752s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:38 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b Jul 22 20:44:38 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:38 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5c3cc6ee-8e16-4405-a710-330f9b0f720b" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Lock "cinder-quobyte-5c3cc6ee-8e16-4405-a710-330f9b0f720b" released by "delete_volume" :: held 1.195s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=84,cinder:UPDATE=78,cinder:DELETE=4,cinder:INSERT=18 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.quota [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Created reservations ['11d54224-16fe-421c-b592-379375ca30f4', '64d10b9d-6250-47a1-92e2-09b433769ecf', '333ddbd8-c52d-40c5-8634-47d4c2e9e702', '18d43e9a-7f66-4db2-a19c-6976ee2258c7'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:39 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:39 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Flow 'volume_create_manager' (e5425892-4a2c-4ac8-bb8b-7b5d0f5247ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4ebd93-3ab9-488c-bec4-fbbbbe5be6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4ebd93-3ab9-488c-bec4-fbbbbe5be6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687ccc05-afad-47ab-aee6-075c889c53f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041c7605d8a94201a10801428928cfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:39Z,use_quota=True,user_id='654af7822c2f49d6bb1086cbfe0d7f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76e7d5c6-1fd9-4b4b-a5f3-bf51361fcf86),volume_type_id=76e7d5c6-1fd9-4b4b-a5f3-bf51361fcf86)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2dcbda-99cc-4d2a-b11d-c6213287f9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2dcbda-99cc-4d2a-b11d-c6213287f9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b070f4-0225-4820-9953-e413d34fbc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:44:39 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.467s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.manager [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Deleted volume successfully. Jul 22 20:44:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-1620fe0e-1c2c-4310-9c5d-03f85d22ed48 req-07653475-0b29-4635-9905-153c499b3969 tempest-TestShelveInstance-1658812540 None] Lock "cinder-5c3cc6ee-8e16-4405-a710-330f9b0f720b-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b070f4-0225-4820-9953-e413d34fbc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '687ccc05-afad-47ab-aee6-075c889c53f8', 'volume_name': 'volume-687ccc05-afad-47ab-aee6-075c889c53f8', 'volume_size': 1, 'image_id': '5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1caf149b30d6e12548183cbb746726f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '041c7605d8a94201a10801428928cfe8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '12a96065da7bfd7df42493ac64a923bfe3f0191d040a06e9e7d44de3b9c787db6f47b0bd7741aa8f906fd7539f56173ff2c158890461daa3cec61344725d0fea', 'id': '5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'created_at': datetime.datetime(2026, 7, 22, 18, 44, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 44, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884f8c67-b70a-4c5b-9156-1f486dde01f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884f8c67-b70a-4c5b-9156-1f486dde01f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10afc1dd-f02d-409c-8511-78cf93c9eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:40 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Volume 687ccc05-afad-47ab-aee6-075c889c53f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-687ccc05-afad-47ab-aee6-075c889c53f8', 'volume_size': 1, 'image_id': '5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1caf149b30d6e12548183cbb746726f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '041c7605d8a94201a10801428928cfe8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '12a96065da7bfd7df42493ac64a923bfe3f0191d040a06e9e7d44de3b9c787db6f47b0bd7741aa8f906fd7539f56173ff2c158890461daa3cec61344725d0fea', 'id': '5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'created_at': datetime.datetime(2026, 7, 22, 18, 44, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 44, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Trying to clone 687ccc05-afad-47ab-aee6-075c889c53f8 from image 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Flow 'volume_create_manager' (afda2945-e053-4f34-9507-23459dab0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6810735-1b65-4c6e-8542-74211091d4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6810735-1b65-4c6e-8542-74211091d4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1087010895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8936211-8982-4df0-b5ed-9b80a2b3bd58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='410f44ef9b6d4f4bb83fc657e306c7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:40Z,use_quota=True,user_id='e6fe6eda85bb4b35aa3c93f88228fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1846a17b-59bf-4a65-b00a-df157d105e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1846a17b-59bf-4a65-b00a-df157d105e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9906e5c6-f268-42b2-ab99-86fdf37605cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9906e5c6-f268-42b2-ab99-86fdf37605cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8936211-8982-4df0-b5ed-9b80a2b3bd58', 'volume_name': 'volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de40cad6-64f9-48d6-9a19-20681b092f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de40cad6-64f9-48d6-9a19-20681b092f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f65cb9-ae56-486f-afaf-642780bbac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:40 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Volume f8936211-8982-4df0-b5ed-9b80a2b3bd58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58', 'volume_size': 1} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1087010895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8936211-8982-4df0-b5ed-9b80a2b3bd58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='410f44ef9b6d4f4bb83fc657e306c7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:40Z,use_quota=True,user_id='e6fe6eda85bb4b35aa3c93f88228fbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Creating volume f8936211-8982-4df0-b5ed-9b80a2b3bd58 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:44:40 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:44:40 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Image download 0.00 MB at 0.00 MB/s Jul 22 20:44:40 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 1073741824 Jul 22 20:44:40 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f913465f-e3e9-41a5-a399-30a80f36bf48]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:40 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD Jul 22 20:44:40 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:40 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:40 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 1073741824" returned: 0 in 0.574s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:40 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD Jul 22 20:44:40 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:40 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 Jul 22 20:44:40 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:41 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:41 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:41 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Temporary image 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f is fetched for user 654af7822c2f49d6bb1086cbfe0d7f0c. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:44:41 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58" returned: 0 in 0.440s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f65cb9-ae56-486f-afaf-642780bbac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d119318-9a7a-4309-901a-a219c0af6716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd79daf4-f81a-4caf-a9e9-7a5b5475edf1]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Volume volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 (f8936211-8982-4df0-b5ed-9b80a2b3bd58): created successfully Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d119318-9a7a-4309-901a-a219c0af6716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Flow 'volume_create_manager' (afda2945-e053-4f34-9507-23459dab0b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-9c315bad-f9c3-4b1c-9784-3884e0ec8e25 req-66919662-87ca-494d-ad4b-b6ec3b72b168 tempest-VolumesGetTestJSON-1884588671 None] Created volume successfully. Jul 22 20:44:41 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.341s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:44:41 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD Jul 22 20:44:41 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:41 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:41 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD Jul 22 20:44:41 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:42 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687ccc05-afad-47ab-aee6-075c889c53f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041c7605d8a94201a10801428928cfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:39Z,use_quota=True,user_id='654af7822c2f49d6bb1086cbfe0d7f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76e7d5c6-1fd9-4b4b-a5f3-bf51361fcf86),volume_type_id=76e7d5c6-1fd9-4b4b-a5f3-bf51361fcf86)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Creating volume 687ccc05-afad-47ab-aee6-075c889c53f8 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:44:42 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:42 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 1073741824 Jul 22 20:44:42 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Acquiring lock "cinder-f8936211-8982-4df0-b5ed-9b80a2b3bd58-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Lock "cinder-f8936211-8982-4df0-b5ed-9b80a2b3bd58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Acquiring lock "cinder-quobyte-f8936211-8982-4df0-b5ed-9b80a2b3bd58" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Lock "cinder-quobyte-f8936211-8982-4df0-b5ed-9b80a2b3bd58" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3dc47e-2fa9-47af-b23d-84b23b20768b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:42 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 1073741824" returned: 0 in 0.541s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:42 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 Jul 22 20:44:42 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:42 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 Jul 22 20:44:42 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:43 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8" returned: 0 in 0.298s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.824s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4d2911-02c3-47f4-8a2f-8a4a3584f125]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Attempting download of 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f ((None, [{'url': 'file:///opt/stack/data/glance/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'metadata': {}}])) to volume 687ccc05-afad-47ab-aee6-075c889c53f8. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:44:43 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58" returned: 0 in 0.411s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:43 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58 Jul 22 20:44:43 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6430ab74-7d71-4980-9cc3-3d137e2f610a]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_o8xotq86 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:43 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:44:43 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:43 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_o8xotq86 Jul 22 20:44:43 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:43 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f8936211-8982-4df0-b5ed-9b80a2b3bd58" returned: 0 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Lock "cinder-quobyte-f8936211-8982-4df0-b5ed-9b80a2b3bd58" released by "delete_volume" :: held 0.819s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG cinder.quota [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Created reservations ['31503e92-5350-4384-a220-6844a5151263', '02ef696e-d2e5-4107-968b-0ecea8e5546f', 'b24ac8c7-a82f-4481-8bfe-da2e56af89f3', '0ee35109-3638-4667-ac3d-fa992d781072'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:43 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_o8xotq86" returned: 0 in 0.447s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_o8xotq86 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:43 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.585s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:43 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:43 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9968bbc-6408-4fce-869b-b134dfa5962e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:43 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_o8xotq86 Jul 22 20:44:43 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:43 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:44:43 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:43 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.295s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG cinder.manager [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Deleted volume successfully. Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [req-d78658dc-1fb5-4a49-86d8-a2a0fb222ac5 req-4a0f89dc-9e79-4b76-b6e2-4d947c147334 tempest-VolumesGetTestJSON-1884588671 None] Lock "cinder-f8936211-8982-4df0-b5ed-9b80a2b3bd58-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:44 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_o8xotq86" returned: 1 in 0.461s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_o8xotq86' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[370608c5-934c-43da-a293-39011aec8a9c]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:44 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.453s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.61bc7fe6-2170-4bb3-ba5f-69e86527498bt7xcjyn1.img {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:44 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.61bc7fe6-2170-4bb3-ba5f-69e86527498bt7xcjyn1.img Jul 22 20:44:44 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:44 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD Jul 22 20:44:44 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:44 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:44 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD Jul 22 20:44:44 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:45 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD" returned: 1 in 0.784s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:44:45 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f was raw, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:44:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:45 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 Jul 22 20:44:45 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:46 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8" returned: 0 in 1.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:46 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ae32ed8-8ef2-4ea1-a51e-f917b52c969f_2l9e0gy4devstack@QuobyteHD, size 0.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:44:46 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 20:44:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:46 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 1G Jul 22 20:44:46 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:47 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 1G" returned: 0 in 0.977s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Downloaded image 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f ((None, [{'url': 'file:///opt/stack/data/glance/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'metadata': {}}])) to volume 687ccc05-afad-47ab-aee6-075c889c53f8 successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Temporary image 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f for user 654af7822c2f49d6bb1086cbfe0d7f0c is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Marking volume 687ccc05-afad-47ab-aee6-075c889c53f8 as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Copying metadata from image 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f to 687ccc05-afad-47ab-aee6-075c889c53f8. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Creating volume glance metadata for volume 687ccc05-afad-47ab-aee6-075c889c53f8 backed by image 5ae32ed8-8ef2-4ea1-a51e-f917b52c969f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1caf149b30d6e12548183cbb746726f0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10afc1dd-f02d-409c-8511-78cf93c9eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687ccc05-afad-47ab-aee6-075c889c53f8', 'volume_size': 1, 'image_id': '5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1caf149b30d6e12548183cbb746726f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '041c7605d8a94201a10801428928cfe8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '12a96065da7bfd7df42493ac64a923bfe3f0191d040a06e9e7d44de3b9c787db6f47b0bd7741aa8f906fd7539f56173ff2c158890461daa3cec61344725d0fea', 'id': '5ae32ed8-8ef2-4ea1-a51e-f917b52c969f', 'created_at': datetime.datetime(2026, 7, 22, 18, 44, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 44, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ae32ed8-8ef2-4ea1-a51e-f917b52c969f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149c45a3-2a41-4760-9ab5-b05e0a895bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:47 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Volume volume-687ccc05-afad-47ab-aee6-075c889c53f8 (687ccc05-afad-47ab-aee6-075c889c53f8): created successfully Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149c45a3-2a41-4760-9ab5-b05e0a895bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:47 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Flow 'volume_create_manager' (e5425892-4a2c-4ac8-bb8b-7b5d0f5247ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:48 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c86d793f-804b-405e-a293-9be66f13ef40 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Created volume successfully. Jul 22 20:44:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Acquiring lock "cinder-687ccc05-afad-47ab-aee6-075c889c53f8-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "cinder-687ccc05-afad-47ab-aee6-075c889c53f8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Acquiring lock "cinder-quobyte-687ccc05-afad-47ab-aee6-075c889c53f8" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:44:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "cinder-quobyte-687ccc05-afad-47ab-aee6-075c889c53f8" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:44:48 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b741a22c-f442-47cb-916b-c033af085d8a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:49 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 Jul 22 20:44:49 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:49 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8" returned: 0 in 1.079s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:49 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8 Jul 22 20:44:49 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:50 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.61bc7fe6-2170-4bb3-ba5f-69e86527498bt7xcjyn1.img" returned: 0 in 5.864s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c241a0-8340-4b2d-82d4-e6767dae4b65]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:50 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:44:50 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:50 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-687ccc05-afad-47ab-aee6-075c889c53f8" returned: 0 in 0.401s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "cinder-quobyte-687ccc05-afad-47ab-aee6-075c889c53f8" released by "delete_volume" :: held 1.606s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:50 devstack cinder-volume[87818]: WARNING cinder.quota [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:44:50 devstack cinder-volume[87818]: WARNING cinder.quota [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Created reservations ['737b58ba-e6bf-4da4-8882-71885e692957', '50aa8907-fdd4-45d6-bb0b-4c4f036d0c9c', 'f6b44b58-c451-4996-9ba0-95cb2f1b979a', '11244484-3c78-425f-a75d-a82bd6218cf8'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:44:50 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:44:50 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:44:50 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.666s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.61bc7fe6-2170-4bb3-ba5f-69e86527498bt7xcjyn1.img {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:44:50 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Converted 1024.00 MB image at 174.51 MB/s Jul 22 20:44:50 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:44:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Deleted volume successfully. Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] 61bc7fe6-2170-4bb3-ba5f-69e86527498b was raw, no need to convert to raw {{(pid=87818) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 22 20:44:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-18a71ae7-edb8-485a-8ca0-3640b51a83e1 tempest-VolumeAndVolumeTypeFromImageTest-1394347971 None] Lock "cinder-687ccc05-afad-47ab-aee6-075c889c53f8-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Flow 'volume_create_manager' (6848fd32-ddea-4e84-9340-265d519868b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35414cca-5b4a-4162-b8a5-e56598a436cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35414cca-5b4a-4162-b8a5-e56598a436cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-612694559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0f053a-b587-4ca5-99b2-02584e8fccc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b779f2a43dd47fe944b01c2f0feca0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:58Z,use_quota=True,user_id='b81d38569ff448c7acbb9dd53d388b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64262a4e-95a6-4af8-8d05-84594d128dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64262a4e-95a6-4af8-8d05-84594d128dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b7c14-450b-405b-a509-05d4e149cb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b7c14-450b-405b-a509-05d4e149cb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0f053a-b587-4ca5-99b2-02584e8fccc9', 'volume_name': 'volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb514a1-a631-4cac-96d7-190d4427bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb514a1-a631-4cac-96d7-190d4427bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd8a915-19b5-4f17-88ce-e5930c59ddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:44:58 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Volume 9f0f053a-b587-4ca5-99b2-02584e8fccc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9', 'volume_size': 1} Jul 22 20:44:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:44:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ea0e860e-6883-4b54-b50c-a71cb5adb8aa tempest-GroupsTest-663586737 None] Group tempest-Group1-145043996: creating Jul 22 20:44:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ea0e860e-6883-4b54-b50c-a71cb5adb8aa tempest-GroupsTest-663586737 None] Group tempest-Group1-145043996: created successfully Jul 22 20:44:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ea0e860e-6883-4b54-b50c-a71cb5adb8aa tempest-GroupsTest-663586737 None] Create group completed successfully. Jul 22 20:45:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6ba8a384-7d06-4abf-872e-073de98d2f6f tempest-GroupsTest-663586737 None] Group tempest-Group2-945246636: creating Jul 22 20:45:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6ba8a384-7d06-4abf-872e-073de98d2f6f tempest-GroupsTest-663586737 None] Group tempest-Group2-945246636: created successfully Jul 22 20:45:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6ba8a384-7d06-4abf-872e-073de98d2f6f tempest-GroupsTest-663586737 None] Create group completed successfully. Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Flow 'volume_create_manager' (68a94357-61c2-4d24-a1bf-cd375e7ed8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df09f7ab-2ea3-49b6-8a9d-22fc7570e970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df09f7ab-2ea3-49b6-8a9d-22fc7570e970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-300362960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9f9b454-ccda-4fe7-b6b5-7423ebfd4f45,host='devstack@QuobyteHD#QuobyteHD',id=7e2d7727-924d-4ede-8e36-e60c11c96aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f01988dd23f4e4a92c66af82f56f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:02Z,use_quota=True,user_id='449e1abe11ed42bfbb4f7affe57fd286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83bc4470-d69d-484e-baea-6815ccb5ea2a),volume_type_id=83bc4470-d69d-484e-baea-6815ccb5ea2a)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a593ec3-b65e-429f-b8e5-5d85b5531c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a593ec3-b65e-429f-b8e5-5d85b5531c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e99502-0985-4c82-b29d-50bd18fbbbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e99502-0985-4c82-b29d-50bd18fbbbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2d7727-924d-4ede-8e36-e60c11c96aab', 'volume_name': 'volume-7e2d7727-924d-4ede-8e36-e60c11c96aab', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b32aef-a4ff-4c64-b77d-516712d0dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b32aef-a4ff-4c64-b77d-516712d0dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9185b907-8987-4076-bbbf-d86b9535b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:02 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Volume 7e2d7727-924d-4ede-8e36-e60c11c96aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2d7727-924d-4ede-8e36-e60c11c96aab', 'volume_size': 1} Jul 22 20:45:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (b1905126-f615-4dd2-82b9-2a65d3579140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045593da-5a4e-43df-803e-9651f2237f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045593da-5a4e-43df-803e-9651f2237f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667078121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d77c0-2939-4f66-9901-bad21432d15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:05Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13b4a43-91ab-4a04-96cc-455836d02b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13b4a43-91ab-4a04-96cc-455836d02b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a91f198-5cd0-44f0-8524-dcc0f2ad3975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a91f198-5cd0-44f0-8524-dcc0f2ad3975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3d77c0-2939-4f66-9901-bad21432d15a', 'volume_name': 'volume-de3d77c0-2939-4f66-9901-bad21432d15a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbcf490-367b-44c4-b988-3b8578345dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbcf490-367b-44c4-b988-3b8578345dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0261f3fa-21b9-4383-a6de-1d90ebcd5dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Volume de3d77c0-2939-4f66-9901-bad21432d15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3d77c0-2939-4f66-9901-bad21432d15a', 'volume_size': 1} Jul 22 20:45:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.709s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Uploaded volume to glance image-id: 61bc7fe6-2170-4bb3-ba5f-69e86527498b. {{(pid=87818) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.579s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-612694559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0f053a-b587-4ca5-99b2-02584e8fccc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b779f2a43dd47fe944b01c2f0feca0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:44:58Z,use_quota=True,user_id='b81d38569ff448c7acbb9dd53d388b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Creating volume 9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:13 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:13 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 1073741824 Jul 22 20:45:13 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bf50d996-33c3-4e8f-abf5-f5ad89d153a1 tempest-VolumesActionsTest-1724702486 None] Copy volume to image completed successfully. Jul 22 20:45:14 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 1073741824" returned: 0 in 0.442s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:14 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 Jul 22 20:45:14 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:14 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9" returned: 0 in 0.239s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9f9b454-ccda-4fe7-b6b5-7423ebfd4f45,created_at=2026-07-22T18:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-300362960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9f9b454-ccda-4fe7-b6b5-7423ebfd4f45,host='devstack@QuobyteHD#QuobyteHD',id=7e2d7727-924d-4ede-8e36-e60c11c96aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f01988dd23f4e4a92c66af82f56f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:02Z,use_quota=True,user_id='449e1abe11ed42bfbb4f7affe57fd286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83bc4470-d69d-484e-baea-6815ccb5ea2a),volume_type_id=83bc4470-d69d-484e-baea-6815ccb5ea2a)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Creating volume 7e2d7727-924d-4ede-8e36-e60c11c96aab {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:14 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd8a915-19b5-4f17-88ce-e5930c59ddcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:14 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab 1073741824 Jul 22 20:45:14 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfc9024-bab3-4db6-becf-ca71c9c01794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Volume volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 (9f0f053a-b587-4ca5-99b2-02584e8fccc9): created successfully Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfc9024-bab3-4db6-becf-ca71c9c01794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Flow 'volume_create_manager' (6848fd32-ddea-4e84-9340-265d519868b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9520490f-b001-45eb-960e-7591236524e5 tempest-VolumeDependencyTests-160684313 None] Created volume successfully. Jul 22 20:45:14 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab 1073741824" returned: 0 in 0.430s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:15 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab Jul 22 20:45:15 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:15 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab" returned: 0 in 0.256s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.916s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667078121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d77c0-2939-4f66-9901-bad21432d15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:05Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Creating volume de3d77c0-2939-4f66-9901-bad21432d15a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:15 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9185b907-8987-4076-bbbf-d86b9535b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2d7727-924d-4ede-8e36-e60c11c96aab', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:15 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a 1073741824 Jul 22 20:45:15 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d65498a-92c5-40f2-b2ed-639effde35e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:15 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Volume volume-7e2d7727-924d-4ede-8e36-e60c11c96aab (7e2d7727-924d-4ede-8e36-e60c11c96aab): created successfully Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d65498a-92c5-40f2-b2ed-639effde35e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Flow 'volume_create_manager' (68a94357-61c2-4d24-a1bf-cd375e7ed8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9c4fa3b7-822d-4b46-83ff-6ef599ffc2f0 tempest-GroupsTest-663586737 None] Created volume successfully. Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:15 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a 1073741824" returned: 0 in 0.535s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:15 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a Jul 22 20:45:15 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:16 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.515s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0261f3fa-21b9-4383-a6de-1d90ebcd5dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3d77c0-2939-4f66-9901-bad21432d15a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096eee01-97c5-46db-b0be-15605aa9e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Creating offline snapshot 5cca74ac-3f10-4688-befb-a82dd63ce4b4 of volume 9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:45:16 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Volume volume-de3d77c0-2939-4f66-9901-bad21432d15a (de3d77c0-2939-4f66-9901-bad21432d15a): created successfully Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096eee01-97c5-46db-b0be-15605aa9e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (b1905126-f615-4dd2-82b9-2a65d3579140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7f665-0a94-45ec-ab32-449ded75c986]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d79301f0-cf01-4087-a0ba-472b8ca6c83e tempest-ProjectReaderTests-134487157 None] Created volume successfully. Jul 22 20:45:16 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 Jul 22 20:45:16 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:16 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9" returned: 0 in 0.357s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:16 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 1G Jul 22 20:45:16 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:16 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 1G" returned: 0 in 0.438s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:16 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 Jul 22 20:45:16 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Acquiring lock "cinder-quobyte-7e2d7727-924d-4ede-8e36-e60c11c96aab" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Lock "cinder-quobyte-7e2d7727-924d-4ede-8e36-e60c11c96aab" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15f999a-644f-4730-b933-9424e600caa3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-de3d77c0-2939-4f66-9901-bad21432d15a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Lock "cinder-de3d77c0-2939-4f66-9901-bad21432d15a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-quobyte-de3d77c0-2939-4f66-9901-bad21432d15a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:17 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab Jul 22 20:45:17 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-de3d77c0-2939-4f66-9901-bad21432d15a" acquired by "delete_volume" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3fd4c7-ca33-4b4d-9934-f30108a18bcf]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:17 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4" returned: 0 in 0.385s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:17 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 is being set with open permissions: ugo+rw Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:17 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 Jul 22 20:45:17 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:17 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a Jul 22 20:45:17 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:17 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab" returned: 0 in 0.415s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:17 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab Jul 22 20:45:17 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:17 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:17 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a" returned: 0 in 0.390s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:17 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a Jul 22 20:45:17 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:17 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.info Jul 22 20:45:17 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:17 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7e2d7727-924d-4ede-8e36-e60c11c96aab" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Lock "cinder-quobyte-7e2d7727-924d-4ede-8e36-e60c11c96aab" released by "delete_volume" :: held 0.745s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Created reservations ['490a3f6c-ef97-4cf3-909f-ed1e08d10b00'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:17 devstack cinder-volume[87818]: WARNING cinder.quota [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-941449727 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-941449727, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:45:17 devstack cinder-volume[87818]: WARNING cinder.quota [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-941449727 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-941449727, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Created reservations ['c3c64620-2383-4465-ac99-2a0d174132e4', 'e2ddb5f5-689b-4269-9817-dce5900f352a', '9467eaf1-0272-4cbf-bd47-53c74325718a', 'a57c2ce7-29b4-4d72-b512-2dcb48eea3de'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:17 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-de3d77c0-2939-4f66-9901-bad21432d15a" returned: 0 in 0.266s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-de3d77c0-2939-4f66-9901-bad21432d15a" released by "delete_volume" :: held 0.704s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:17 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.info" returned: 0 in 0.280s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:17 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.info is being set with open permissions: ugo+rw Jul 22 20:45:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:17 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.info Jul 22 20:45:17 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Created reservations ['dcc77555-8b7d-4d81-ade8-65f3c971ae73', '63cc2c33-c954-4f28-8d50-7f0938d0bb16', 'e53dc197-2956-4d09-b716-19998f358d16', '756b89e7-b545-462b-98cf-c3d83837c1db'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:18 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:18 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:18 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.info" returned: 0 in 0.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.503s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0045f3-56d6-4b57-8596-3b61e49db279]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:18 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.318s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f0abf2a5-597e-4949-9191-0a66ed3bf3ff tempest-GroupsTest-663586737 None] Delete group completed successfully. Jul 22 20:45:18 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:45:18 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:18 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-167be638-eb63-4806-9f96-5df11ae462dc tempest-VolumeDependencyTests-160684313 None] Create snapshot completed successfully Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.440s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:18 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:18 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aabc60f-7a48-404f-bac6-0f239d7dc10b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Created reservations ['2a64bfa2-df48-4714-a3a1-3d0cc033f34b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:18 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:18 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:19 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:45:19 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:19 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.385s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Deleted volume successfully. Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9eb688b9-5b9d-4b12-8da4-cb120b0e4a2e tempest-ProjectReaderTests-134487157 None] Lock "cinder-de3d77c0-2939-4f66-9901-bad21432d15a-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (804caafb-8631-4650-b18e-99933d82f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8b05d-a215-4688-8481-9c5bef39521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.400s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8b05d-a215-4688-8481-9c5bef39521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286704525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37983a80-492c-4cd1-a842-9ecad71b9a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:19Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069269a7-6611-4c36-b6c6-2078faefc357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069269a7-6611-4c36-b6c6-2078faefc357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2190dca8-b498-4f8d-8d98-8514dbe334f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2190dca8-b498-4f8d-8d98-8514dbe334f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37983a80-492c-4cd1-a842-9ecad71b9a14', 'volume_name': 'volume-37983a80-492c-4cd1-a842-9ecad71b9a14', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829abc32-071d-464d-8d45-f0ce911cba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829abc32-071d-464d-8d45-f0ce911cba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315893c-2a7e-44c5-8788-f1860d0b7e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Volume 37983a80-492c-4cd1-a842-9ecad71b9a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37983a80-492c-4cd1-a842-9ecad71b9a14', 'volume_size': 1} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-34279cbc-9eba-40bd-8b52-d5fd524accd6 tempest-GroupsTest-663586737 None] Delete group completed successfully. Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.593s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:19 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img Jul 22 20:45:19 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Flow 'volume_create_manager' (e2b45ca1-4926-4875-8735-8789c5872f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69cca34-97d6-41fb-ba7f-854f80c0796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69cca34-97d6-41fb-ba7f-854f80c0796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2061820341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2462b4f-e008-4878-81e4-93b1b416b43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b779f2a43dd47fe944b01c2f0feca0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5cca74ac-3f10-4688-befb-a82dd63ce4b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:20Z,use_quota=True,user_id='b81d38569ff448c7acbb9dd53d388b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d77cebe-39f9-4ce6-b3e2-317c2b5dc02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d77cebe-39f9-4ce6-b3e2-317c2b5dc02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d28802d-d960-45ec-9659-58df33e8467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d28802d-d960-45ec-9659-58df33e8467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2462b4f-e008-4878-81e4-93b1b416b43c', 'volume_name': 'volume-b2462b4f-e008-4878-81e4-93b1b416b43c', 'volume_size': 1, 'snapshot_id': '5cca74ac-3f10-4688-befb-a82dd63ce4b4'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b85ff8-ec77-4453-89f3-91f089704579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b85ff8-ec77-4453-89f3-91f089704579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784bbc73-0b9d-4b6d-83a7-f8a312db37ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:19 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Volume b2462b4f-e008-4878-81e4-93b1b416b43c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2462b4f-e008-4878-81e4-93b1b416b43c', 'volume_size': 1, 'snapshot_id': '5cca74ac-3f10-4688-befb-a82dd63ce4b4'} Jul 22 20:45:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d917e5a7-ad54-4966-9d0a-cdc0bd3ad9bb tempest-GroupsTest-663586737 None] Group tempest-GroupsTest-Group-309002390: creating Jul 22 20:45:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d917e5a7-ad54-4966-9d0a-cdc0bd3ad9bb tempest-GroupsTest-663586737 None] Group tempest-GroupsTest-Group-309002390: created successfully Jul 22 20:45:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d917e5a7-ad54-4966-9d0a-cdc0bd3ad9bb tempest-GroupsTest-663586737 None] Create group completed successfully. Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Flow 'volume_create_manager' (38582715-6e23-4b30-af36-43a3b861c55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1285fc-4cb8-405b-bda1-303a13e87ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1285fc-4cb8-405b-bda1-303a13e87ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066456233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=449e13b1-3903-43df-8e9e-510a49fe8388,host='devstack@QuobyteHD#QuobyteHD',id=044d67a8-2e55-4650-bd8a-9a6e28de37eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f01988dd23f4e4a92c66af82f56f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:24Z,use_quota=True,user_id='449e1abe11ed42bfbb4f7affe57fd286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d77aeae-67bb-4092-948b-9cbd27756494),volume_type_id=3d77aeae-67bb-4092-948b-9cbd27756494)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f075c9a-b846-45f4-9e02-30425ff3382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f075c9a-b846-45f4-9e02-30425ff3382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4a6920-db80-4daf-bf8c-14a9b02b2072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4a6920-db80-4daf-bf8c-14a9b02b2072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044d67a8-2e55-4650-bd8a-9a6e28de37eb', 'volume_name': 'volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cf7876-5869-49fe-9a75-cd3f2983e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cf7876-5869-49fe-9a75-cd3f2983e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b23667-a0f7-4433-bae1-209a67c10223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:23 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Volume 044d67a8-2e55-4650-bd8a-9a6e28de37eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb', 'volume_size': 1} Jul 22 20:45:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:24 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img" returned: 0 in 4.766s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a2cb5-c1b9-404c-aefb-7271a58b1947]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:24 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:45:24 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:24 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.530s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:45:24 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Converted 1024.00 MB image at 214.79 MB/s Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] a60bfc01-b635-441d-8527-0f6eef5a3116 was raw, converting to qcow2 {{(pid=87818) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c611ae-db6c-4c11-beb0-e7601a867929]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:24 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img Jul 22 20:45:24 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:25 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img" returned: 0 in 0.321s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:25 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img Jul 22 20:45:25 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:25 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img" returned: 1 in 0.315s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img /opt/stack/data/cinder/conversion/vol_upload_a54cby7v {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:25 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img /opt/stack/data/cinder/conversion/vol_upload_a54cby7v Jul 22 20:45:25 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:25 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img /opt/stack/data/cinder/conversion/vol_upload_a54cby7v" returned: 0 in 0.265s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Image conversion details: src /opt/stack/data/cinder/conversion/990a91a4-01fa-49a6-9c2f-de51d4c1eee3.temp_image.a60bfc01-b635-441d-8527-0f6eef5a31164cszudr9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a54cby7v {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:45:25 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[81342757-9bf7-4aba-8c77-be33a5727841]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a54cby7v {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:25 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a54cby7v Jul 22 20:45:25 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:25 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a54cby7v" returned: 0 in 0.319s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.925s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Uploaded volume to glance image-id: a60bfc01-b635-441d-8527-0f6eef5a3116. {{(pid=87818) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.852s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286704525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37983a80-492c-4cd1-a842-9ecad71b9a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:19Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Creating volume 37983a80-492c-4cd1-a842-9ecad71b9a14 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:27 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:27 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 1073741824 Jul 22 20:45:27 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-37565eb8-daf6-4ee2-8957-5c730bb5f969 tempest-VolumesActionsTest-1724702486 None] Copy volume to image completed successfully. Jul 22 20:45:27 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 1073741824" returned: 0 in 0.441s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:27 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 Jul 22 20:45:27 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:28 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.277s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-quobyte-5cca74ac-3f10-4688-befb-a82dd63ce4b4-b2462b4f-e008-4878-81e4-93b1b416b43c" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315893c-2a7e-44c5-8788-f1860d0b7e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37983a80-492c-4cd1-a842-9ecad71b9a14', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8ed8af-1e80-4eb1-a2ea-df92afe0f431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-5cca74ac-3f10-4688-befb-a82dd63ce4b4-b2462b4f-e008-4878-81e4-93b1b416b43c" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Creating volume b2462b4f-e008-4878-81e4-93b1b416b43c from snapshot 5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-quobyte-b2462b4f-e008-4878-81e4-93b1b416b43c" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Volume volume-37983a80-492c-4cd1-a842-9ecad71b9a14 (37983a80-492c-4cd1-a842-9ecad71b9a14): created successfully Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8ed8af-1e80-4eb1-a2ea-df92afe0f431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (804caafb-8631-4650-b18e-99933d82f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-b2462b4f-e008-4878-81e4-93b1b416b43c" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] snapshot: 5cca74ac-3f10-4688-befb-a82dd63ce4b4, volume: b2462b4f-e008-4878-81e4-93b1b416b43c, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:45:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-651c9cd7-50bb-44b6-891d-b2fcb197caf3 tempest-ProjectReaderTests-134487157 None] Created volume successfully. Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943c882-4062-47d3-a852-656620d16dab]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "cinder-quobyte-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-quobyte-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:28 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 Jul 22 20:45:28 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3955ad3-0678-47e8-b229-953cb1c6f226]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:28 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:45:28 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:28 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4" returned: 0 in 0.391s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a3f78b-96d0-4d52-9fd1-c0060f41204f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:28 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.364s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:28 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 Jul 22 20:45:28 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:28 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3 Jul 22 20:45:28 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:28 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" returned: 0 in 0.255s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:28 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9" returned: 0 in 0.377s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-quobyte-990a91a4-01fa-49a6-9c2f-de51d4c1eee3" released by "delete_volume" :: held 0.684s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:28 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c Jul 22 20:45:28 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-37983a80-492c-4cd1-a842-9ecad71b9a14-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Created reservations ['890b2c7e-2ad7-4422-9a6f-a39b287af960', '18016a81-d655-4269-a59f-adc2eaa4198e', '2652ef40-b4b6-449d-902c-fe9949e68118', 'c78182f7-e74f-4e34-9c1e-cc7d231165c3'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Lock "cinder-37983a80-492c-4cd1-a842-9ecad71b9a14-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-quobyte-37983a80-492c-4cd1-a842-9ecad71b9a14" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-37983a80-492c-4cd1-a842-9ecad71b9a14" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f463f090-c4c3-48d8-9e74-05c4997e535b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:29 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:29 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:29 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 Jul 22 20:45:29 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:29 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.286s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:29 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Deleted volume successfully. Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d7d970c9-b67d-4eb9-84cf-67171b616259 tempest-VolumesActionsTest-1724702486 None] Lock "cinder-990a91a4-01fa-49a6-9c2f-de51d4c1eee3-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:29 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14" returned: 0 in 0.611s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:29 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14 Jul 22 20:45:29 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:30 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-37983a80-492c-4cd1-a842-9ecad71b9a14" returned: 0 in 0.763s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-37983a80-492c-4cd1-a842-9ecad71b9a14" released by "delete_volume" :: held 1.446s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Created reservations ['19550fad-ce75-45a7-83b3-630e982b8657', 'a9cab7aa-f58d-4999-90d0-696cec85f493', '916c2ff0-c0f2-4368-b59a-27adb342b382', '834c73a9-57d8-468b-ace8-0bed6a833205'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:31 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:31 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:31 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.717s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:31 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Deleted volume successfully. Jul 22 20:45:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7662dceb-2354-4f69-9f72-8c4392fe716e tempest-ProjectReaderTests-134487157 None] Lock "cinder-37983a80-492c-4cd1-a842-9ecad71b9a14-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (6c84dae2-46e6-4b56-a7cd-13017d301e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6af723-319c-477c-9bce-93175a49fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6af723-319c-477c-9bce-93175a49fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190220691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db66123-134e-489f-af3a-ca96d9d15267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:33Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c1bd37-08ef-4364-9362-91cc9d645e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c1bd37-08ef-4364-9362-91cc9d645e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aacb83a-95bc-48a3-baf8-520da4a84584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aacb83a-95bc-48a3-baf8-520da4a84584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db66123-134e-489f-af3a-ca96d9d15267', 'volume_name': 'volume-0db66123-134e-489f-af3a-ca96d9d15267', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27379f99-616b-4606-a9e4-faf2428ed150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27379f99-616b-4606-a9e4-faf2428ed150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad5542c-01a5-4c26-b534-04ccc93816f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:33 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Volume 0db66123-134e-489f-af3a-ca96d9d15267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db66123-134e-489f-af3a-ca96d9d15267', 'volume_size': 1} Jul 22 20:45:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:34 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c" returned: 0 in 5.625s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:34 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90967384-fdc0-4148-9690-f95df3ba896b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:34 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 Jul 22 20:45:34 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:35 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9" returned: 0 in 0.603s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:45:35 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Converted 1024.00 MB image at 182.01 MB/s Jul 22 20:45:35 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c is being set with open permissions: ugo+rw Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:35 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c Jul 22 20:45:35 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:35 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-b2462b4f-e008-4878-81e4-93b1b416b43c" released by "_copy_volume_from_snapshot" :: held 7.384s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-5cca74ac-3f10-4688-befb-a82dd63ce4b4-b2462b4f-e008-4878-81e4-93b1b416b43c" released by "_create_volume_from_snapshot" :: held 7.445s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.487s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.587s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=449e13b1-3903-43df-8e9e-510a49fe8388,created_at=2026-07-22T18:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066456233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=449e13b1-3903-43df-8e9e-510a49fe8388,host='devstack@QuobyteHD#QuobyteHD',id=044d67a8-2e55-4650-bd8a-9a6e28de37eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f01988dd23f4e4a92c66af82f56f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:24Z,use_quota=True,user_id='449e1abe11ed42bfbb4f7affe57fd286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d77aeae-67bb-4092-948b-9cbd27756494),volume_type_id=3d77aeae-67bb-4092-948b-9cbd27756494)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Creating volume 044d67a8-2e55-4650-bd8a-9a6e28de37eb {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:35 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:35 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb 1073741824 Jul 22 20:45:35 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784bbc73-0b9d-4b6d-83a7-f8a312db37ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2462b4f-e008-4878-81e4-93b1b416b43c', 'volume_size': 1, 'snapshot_id': '5cca74ac-3f10-4688-befb-a82dd63ce4b4'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d50cba2-d53f-4858-987a-b36e53c05d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:35 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Volume volume-b2462b4f-e008-4878-81e4-93b1b416b43c (b2462b4f-e008-4878-81e4-93b1b416b43c): created successfully Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d50cba2-d53f-4858-987a-b36e53c05d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Flow 'volume_create_manager' (e2b45ca1-4926-4875-8735-8789c5872f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2cf52a57-4c5b-4229-a5fc-2f6befced418 tempest-VolumeDependencyTests-160684313 None] Created volume successfully. Jul 22 20:45:35 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb 1073741824" returned: 0 in 0.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:36 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb Jul 22 20:45:36 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-5cca74ac-3f10-4688-befb-a82dd63ce4b4-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-5cca74ac-3f10-4688-befb-a82dd63ce4b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-quobyte-9f0f053a-b587-4ca5-99b2-02584e8fccc9" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-9f0f053a-b587-4ca5-99b2-02584e8fccc9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-quobyte-5cca74ac-3f10-4688-befb-a82dd63ce4b4" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-5cca74ac-3f10-4688-befb-a82dd63ce4b4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Deleting offline snapshot 5cca74ac-3f10-4688-befb-a82dd63ce4b4 of volume 9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] snapshot_file for this snap is: volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e46928-f19f-4586-aa4a-83b5f231baef]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:36 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb" returned: 0 in 0.374s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.099s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190220691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db66123-134e-489f-af3a-ca96d9d15267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:33Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Creating volume 0db66123-134e-489f-af3a-ca96d9d15267 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:36 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b23667-a0f7-4433-bae1-209a67c10223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:36 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 1073741824 Jul 22 20:45:36 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c8f125-a1b9-42ce-a466-39435f5ad0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:36 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Volume volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb (044d67a8-2e55-4650-bd8a-9a6e28de37eb): created successfully Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c8f125-a1b9-42ce-a466-39435f5ad0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Flow 'volume_create_manager' (38582715-6e23-4b30-af36-43a3b861c55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=93,cinder:UPDATE=98,cinder:INSERT=31,cinder:DELETE=2 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:45:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9e9f1442-e9e1-43ea-8148-9db5b575578d tempest-GroupsTest-663586737 None] Created volume successfully. Jul 22 20:45:36 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 Jul 22 20:45:36 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:36 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4" returned: 0 in 0.454s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ebbab-c907-47e2-8b7e-603600c3bf25]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:36 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 1073741824" returned: 0 in 0.491s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:36 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 Jul 22 20:45:36 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:36 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 Jul 22 20:45:36 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:37 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267" returned: 0 in 0.293s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:37 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad5542c-01a5-4c26-b534-04ccc93816f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db66123-134e-489f-af3a-ca96d9d15267', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c24d4e2-0599-4fbc-a76b-8ca06d9d3f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:37 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Volume volume-0db66123-134e-489f-af3a-ca96d9d15267 (0db66123-134e-489f-af3a-ca96d9d15267): created successfully Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c24d4e2-0599-4fbc-a76b-8ca06d9d3f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (6c84dae2-46e6-4b56-a7cd-13017d301e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:37 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 Jul 22 20:45:37 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4f975e56-c372-44f7-961c-0cd37e4cd005 tempest-ProjectReaderTests-134487157 None] Created volume successfully. Jul 22 20:45:37 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4" returned: 0 in 0.385s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:37 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4 Jul 22 20:45:37 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:37 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9.5cca74ac-3f10-4688-befb-a82dd63ce4b4" returned: 0 in 0.295s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-5cca74ac-3f10-4688-befb-a82dd63ce4b4" released by "_delete_snapshot" :: held 1.698s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-9f0f053a-b587-4ca5-99b2-02584e8fccc9" released by "delete_snapshot" :: held 1.740s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Created reservations ['6bfda9f8-788e-4e5a-933a-14f96d8f0b66', '4fa124f3-9ee1-4454-ba5b-306b76968da9', '7be5c1fd-b387-4114-b1d2-4d2df8f0fb0b', 'd3c96756-8faa-41fc-913f-22bb28f6bea1'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Delete snapshot completed successfully. Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9bdd4e6d-9beb-4fc5-ba74-4d66b1947525 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-5cca74ac-3f10-4688-befb-a82dd63ce4b4-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Flow 'volume_create_manager' (8b9110db-433e-4bdc-9c1f-2db6d0819db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fc7423-306e-496b-9d66-8f4ab87d3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fc7423-306e-496b-9d66-8f4ab87d3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329528148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=449e13b1-3903-43df-8e9e-510a49fe8388,host='devstack@QuobyteHD#QuobyteHD',id=ca2ca17c-259f-4c15-9cfa-e880f4a00141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f01988dd23f4e4a92c66af82f56f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:38Z,use_quota=True,user_id='449e1abe11ed42bfbb4f7affe57fd286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d77aeae-67bb-4092-948b-9cbd27756494),volume_type_id=3d77aeae-67bb-4092-948b-9cbd27756494)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5bf91c-d34f-40ac-a641-b475f6fc9fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5bf91c-d34f-40ac-a641-b475f6fc9fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f636c4-d7c1-4d49-a044-a3af9c665016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f636c4-d7c1-4d49-a044-a3af9c665016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2ca17c-259f-4c15-9cfa-e880f4a00141', 'volume_name': 'volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee04741-15df-4f60-8f26-aeac3b643d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee04741-15df-4f60-8f26-aeac3b643d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f493737-fe43-4e10-aa1e-a0725cabd2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:38 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Volume ca2ca17c-259f-4c15-9cfa-e880f4a00141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141', 'volume_size': 1} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=449e13b1-3903-43df-8e9e-510a49fe8388,created_at=2026-07-22T18:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329528148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=449e13b1-3903-43df-8e9e-510a49fe8388,host='devstack@QuobyteHD#QuobyteHD',id=ca2ca17c-259f-4c15-9cfa-e880f4a00141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f01988dd23f4e4a92c66af82f56f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:38Z,use_quota=True,user_id='449e1abe11ed42bfbb4f7affe57fd286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d77aeae-67bb-4092-948b-9cbd27756494),volume_type_id=3d77aeae-67bb-4092-948b-9cbd27756494)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Creating volume ca2ca17c-259f-4c15-9cfa-e880f4a00141 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:38 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-0db66123-134e-489f-af3a-ca96d9d15267-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:38 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 1073741824 Jul 22 20:45:38 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Lock "cinder-0db66123-134e-489f-af3a-ca96d9d15267-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-9f0f053a-b587-4ca5-99b2-02584e8fccc9-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Lock "cinder-9f0f053a-b587-4ca5-99b2-02584e8fccc9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-quobyte-0db66123-134e-489f-af3a-ca96d9d15267" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-quobyte-9f0f053a-b587-4ca5-99b2-02584e8fccc9" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-0db66123-134e-489f-af3a-ca96d9d15267" acquired by "delete_volume" :: waited 0.032s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-9f0f053a-b587-4ca5-99b2-02584e8fccc9" acquired by "delete_volume" :: waited 0.043s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa4222-620a-4d95-b170-fce1a50c495b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1202f-0bf2-43db-9299-e68d82585baa]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:38 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 Jul 22 20:45:38 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:38 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 Jul 22 20:45:38 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:38 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 1073741824" returned: 0 in 0.554s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:38 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 Jul 22 20:45:38 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:39 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267" returned: 0 in 0.430s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:39 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267 Jul 22 20:45:39 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:39 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9" returned: 0 in 0.492s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:39 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9 Jul 22 20:45:39 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:39 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141" returned: 0 in 0.358s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=98,cinder:SELECT=82,cinder:DELETE=13,cinder:INSERT=19 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f493737-fe43-4e10-aa1e-a0725cabd2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70af8dc2-8e7f-4791-b7f9-913a8f3f675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:39 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Volume volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 (ca2ca17c-259f-4c15-9cfa-e880f4a00141): created successfully Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70af8dc2-8e7f-4791-b7f9-913a8f3f675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Flow 'volume_create_manager' (8b9110db-433e-4bdc-9c1f-2db6d0819db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b3bb9ea0-6706-466b-a956-afb12503e833 tempest-GroupsTest-663586737 None] Created volume successfully. Jul 22 20:45:39 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0db66123-134e-489f-af3a-ca96d9d15267" returned: 0 in 0.375s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-0db66123-134e-489f-af3a-ca96d9d15267" released by "delete_volume" :: held 0.900s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (9cd848ce-8e27-4376-ad8c-84663c10fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417d8ba9-43ac-486d-97d3-0f70b3895ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417d8ba9-43ac-486d-97d3-0f70b3895ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-388078116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9bfaef-4378-4974-b047-b3a6bc829d85,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:39Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215ba2f-7e55-4167-b92c-3aba88de35e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215ba2f-7e55-4167-b92c-3aba88de35e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c7340f-6e59-4714-af67-4379fc74fc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c7340f-6e59-4714-af67-4379fc74fc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9bfaef-4378-4974-b047-b3a6bc829d85', 'volume_name': 'volume-ef9bfaef-4378-4974-b047-b3a6bc829d85', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dad835-33bb-4dd7-a904-3ffb780f8105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dad835-33bb-4dd7-a904-3ffb780f8105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb01a50-3bdb-4877-9c17-50a5d3551c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:39 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Volume ef9bfaef-4378-4974-b047-b3a6bc829d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9bfaef-4378-4974-b047-b3a6bc829d85', 'volume_size': 1} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-388078116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9bfaef-4378-4974-b047-b3a6bc829d85,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:39Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Creating volume ef9bfaef-4378-4974-b047-b3a6bc829d85 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:39 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:39 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 1073741824 Jul 22 20:45:39 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:39 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9f0f053a-b587-4ca5-99b2-02584e8fccc9" returned: 0 in 0.457s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-9f0f053a-b587-4ca5-99b2-02584e8fccc9" released by "delete_volume" :: held 1.034s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Created reservations ['c60eb739-817e-42af-9f1d-877adea6848f', '2e0d74e3-4816-4f82-a2f3-8d0fb83ea5d8', '2ee9c3e0-a8db-4a45-baf9-4acad1855c36', 'c086c2b0-b2e6-46e6-a477-dde60392a06f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Created reservations ['d8ce5f5c-b87f-4300-8168-534036d1ad78', 'cf53c640-b8e5-4bdf-96fa-537733c5692b', '8cdc4040-68c1-4d20-be0a-8676581d0b34', '5bbe8db6-50dd-4f2b-94ea-054a6d4541db'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:39 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:39 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:39 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:39 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:39 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:39 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Deleted volume successfully. Jul 22 20:45:39 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 1073741824" returned: 0 in 0.447s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-90d77a6a-5762-4936-9391-ff90755dc1cd tempest-ProjectReaderTests-134487157 None] Lock "cinder-0db66123-134e-489f-af3a-ca96d9d15267-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:40 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:40 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 Jul 22 20:45:40 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:40 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Deleted volume successfully. Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1acdd772-fdcd-48f0-8fc5-778cdcff211c tempest-VolumeDependencyTests-160684313 None] Lock "cinder-9f0f053a-b587-4ca5-99b2-02584e8fccc9-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:40 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85" returned: 0 in 0.280s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb01a50-3bdb-4877-9c17-50a5d3551c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9bfaef-4378-4974-b047-b3a6bc829d85', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b75ddc-f2ab-49a4-b776-19fb5a81206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:40 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Volume volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 (ef9bfaef-4378-4974-b047-b3a6bc829d85): created successfully Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b75ddc-f2ab-49a4-b776-19fb5a81206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (9cd848ce-8e27-4376-ad8c-84663c10fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:40 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e2635c4e-c820-440a-a7e3-df3393a1f68d tempest-VolumesGetTest-888641254 None] Created volume successfully. Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-b2462b4f-e008-4878-81e4-93b1b416b43c-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:40 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d2558f75-ffd4-4532-a76e-6ffd18666952 tempest-GroupsTest-663586737 None] Update group completed successfully. Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-b2462b4f-e008-4878-81e4-93b1b416b43c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "cinder-quobyte-b2462b4f-e008-4878-81e4-93b1b416b43c" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-b2462b4f-e008-4878-81e4-93b1b416b43c" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a4b8b-c482-45b9-a8ae-ee2510835efb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:41 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c Jul 22 20:45:41 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (3fe53d12-6d06-43dd-ace6-7da738b8fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc926ab-6253-4d67-853d-072ded14fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc926ab-6253-4d67-853d-072ded14fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1596865399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb741878-ba24-4f5f-ae79-b4eab9b41f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:41Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b258237b-7108-4586-9ef5-e3ea5a6c0a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b258237b-7108-4586-9ef5-e3ea5a6c0a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02545c3-e69b-4393-b1e8-02d28542070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02545c3-e69b-4393-b1e8-02d28542070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb741878-ba24-4f5f-ae79-b4eab9b41f14', 'volume_name': 'volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee5ddf-e149-4580-b2b9-d1654c2f77ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee5ddf-e149-4580-b2b9-d1654c2f77ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b92ce4-0abe-4c8a-8128-d61bdfe1fa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Volume bb741878-ba24-4f5f-ae79-b4eab9b41f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14', 'volume_size': 1} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1596865399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb741878-ba24-4f5f-ae79-b4eab9b41f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0518480ca60543f2b98ab9338d281390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:41Z,use_quota=True,user_id='bc87fdc3d14e4876baeb76355119e392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Creating volume bb741878-ba24-4f5f-ae79-b4eab9b41f14 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:41 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:41 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 1073741824 Jul 22 20:45:41 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:41 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:41 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:41 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c" returned: 0 in 0.457s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cea1bccc-3924-4e88-8483-ec37a9a0475c tempest-GroupsTest-663586737 None] Update group completed successfully. Jul 22 20:45:41 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c Jul 22 20:45:41 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:41 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.314s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:45:41 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b2462b4f-e008-4878-81e4-93b1b416b43c" returned: 0 in 0.347s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-quobyte-b2462b4f-e008-4878-81e4-93b1b416b43c" released by "delete_volume" :: held 0.876s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:41 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 1073741824" returned: 0 in 0.523s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Created reservations ['09a70692-9642-4c95-991e-81d58f31881a', '6d9ee782-666d-449a-b767-8ebd29dd72b6', 'f6908be9-e807-4231-ab90-232f114c4668', '54125939-a99f-4507-8259-2ae279b67509'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:41 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 Jul 22 20:45:41 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:41 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:41 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:42 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14" returned: 0 in 0.357s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b92ce4-0abe-4c8a-8128-d61bdfe1fa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e482e7-6fa0-4cfa-b4de-86d7998627d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Volume volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 (bb741878-ba24-4f5f-ae79-b4eab9b41f14): created successfully Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e482e7-6fa0-4cfa-b4de-86d7998627d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Flow 'volume_create_manager' (3fe53d12-6d06-43dd-ace6-7da738b8fdab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:42 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-79b7ec0e-491a-48a4-8c63-3dfe6cd130de tempest-ProjectReaderTests-134487157 None] Created volume successfully. Jul 22 20:45:42 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:42 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Deleted volume successfully. Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-603e1f09-8125-488b-825d-af64b57e3d55 tempest-VolumeDependencyTests-160684313 None] Lock "cinder-b2462b4f-e008-4878-81e4-93b1b416b43c-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (c2c42a23-2d51-4d07-9833-4f9ddecaf000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cdfe78-53d0-4041-90cd-6d363848b37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cdfe78-53d0-4041-90cd-6d363848b37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-207044941',display_name='tempest-VolumesGetTest-Volume-1805144763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97129519-e182-43e8-baa7-3c4c9431ca1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:42Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b193bf1-bcfd-4df5-91bf-abac28e37477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b193bf1-bcfd-4df5-91bf-abac28e37477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc77291-3b68-41e1-8fc6-c2324bfdc2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc77291-3b68-41e1-8fc6-c2324bfdc2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97129519-e182-43e8-baa7-3c4c9431ca1e', 'volume_name': 'volume-97129519-e182-43e8-baa7-3c4c9431ca1e', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1e4f05-6907-456a-8f36-dce5f09975a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1e4f05-6907-456a-8f36-dce5f09975a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be79f5c0-b2e2-4818-8c0a-33ff565e876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Volume 97129519-e182-43e8-baa7-3c4c9431ca1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97129519-e182-43e8-baa7-3c4c9431ca1e', 'volume_size': 1} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-207044941',display_name='tempest-VolumesGetTest-Volume-1805144763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97129519-e182-43e8-baa7-3c4c9431ca1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:42Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Creating volume 97129519-e182-43e8-baa7-3c4c9431ca1e {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:42 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:42 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e 1073741824 Jul 22 20:45:42 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:42 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e 1073741824" returned: 0 in 0.539s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Acquiring lock "cinder-quobyte-044d67a8-2e55-4650-bd8a-9a6e28de37eb" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Lock "cinder-quobyte-044d67a8-2e55-4650-bd8a-9a6e28de37eb" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5967ad6e-5880-4e93-a229-8aed9ffe9d81]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:43 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e Jul 22 20:45:43 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:43 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb Jul 22 20:45:43 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-bb741878-ba24-4f5f-ae79-b4eab9b41f14-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:43 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e" returned: 0 in 0.349s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Lock "cinder-bb741878-ba24-4f5f-ae79-b4eab9b41f14-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be79f5c0-b2e2-4818-8c0a-33ff565e876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97129519-e182-43e8-baa7-3c4c9431ca1e', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43164306-c3fa-4c6b-bad6-cdad85616df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:43 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Volume volume-97129519-e182-43e8-baa7-3c4c9431ca1e (97129519-e182-43e8-baa7-3c4c9431ca1e): created successfully Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43164306-c3fa-4c6b-bad6-cdad85616df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (c2c42a23-2d51-4d07-9833-4f9ddecaf000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Acquiring lock "cinder-quobyte-bb741878-ba24-4f5f-ae79-b4eab9b41f14" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:43 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1d528c00-c858-49be-a94a-051072a658f1 tempest-VolumesGetTest-888641254 None] Created volume successfully. Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-bb741878-ba24-4f5f-ae79-b4eab9b41f14" acquired by "delete_volume" :: waited 0.033s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b865a338-5161-4032-bf2f-09fc8115a3f1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:43 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb" returned: 0 in 0.530s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:43 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb Jul 22 20:45:43 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:43 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 Jul 22 20:45:43 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:43 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-044d67a8-2e55-4650-bd8a-9a6e28de37eb" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Lock "cinder-quobyte-044d67a8-2e55-4650-bd8a-9a6e28de37eb" released by "delete_volume" :: held 0.851s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Acquiring lock "cinder-quobyte-ca2ca17c-259f-4c15-9cfa-e880f4a00141" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Lock "cinder-quobyte-ca2ca17c-259f-4c15-9cfa-e880f4a00141" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2dfe5a-f025-42e1-8bdb-c5136656c9e8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:43 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14" returned: 0 in 0.415s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:44 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14 Jul 22 20:45:44 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:44 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 Jul 22 20:45:44 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:44 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-bb741878-ba24-4f5f-ae79-b4eab9b41f14" returned: 0 in 0.317s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Lock "cinder-quobyte-bb741878-ba24-4f5f-ae79-b4eab9b41f14" released by "delete_volume" :: held 0.803s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Created reservations ['83dbc88b-9ee2-480b-915e-9e274cd5d314', '6b007ee6-b685-4fa4-88df-1deeffc44406', 'e3a47134-b727-4d06-b0ab-d72fb04169da', 'd83a709a-49f5-4923-a290-5a38a6e84af5'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:44 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141" returned: 0 in 0.560s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:44 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141 Jul 22 20:45:44 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:44 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:44 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-97129519-e182-43e8-baa7-3c4c9431ca1e-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Lock "cinder-97129519-e182-43e8-baa7-3c4c9431ca1e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-97129519-e182-43e8-baa7-3c4c9431ca1e" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-97129519-e182-43e8-baa7-3c4c9431ca1e" acquired by "delete_volume" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[73150f87-e7fd-43ec-9783-43cd7e08fc2d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:44 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca2ca17c-259f-4c15-9cfa-e880f4a00141" returned: 0 in 0.324s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Lock "cinder-quobyte-ca2ca17c-259f-4c15-9cfa-e880f4a00141" released by "delete_volume" :: held 0.930s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:44 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.325s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Deleted volume successfully. Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a54101e9-623c-45e3-b4bf-2b60ec8cc1c0 tempest-ProjectReaderTests-134487157 None] Lock "cinder-bb741878-ba24-4f5f-ae79-b4eab9b41f14-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:44 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e Jul 22 20:45:44 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Created reservations ['d7843cfd-c8f6-4579-8afc-d06da70d486c'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:44 devstack cinder-volume[87818]: WARNING cinder.quota [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2140283776 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2140283776, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:45:44 devstack cinder-volume[87818]: WARNING cinder.quota [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2140283776 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2140283776, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:45:44 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Created reservations ['ce2b0c7a-c878-4997-b0bd-04f386a75afa', 'c9a6bd71-f3e4-46e9-a660-7dd5ff0885fe', '0b71e338-1f05-48f9-94f4-5873f1958a41', '4f7ef013-60df-4925-96c6-a2d90789cec3'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Created reservations ['4b76c8d8-42a5-4da5-8445-712923a39959', 'c9fe0590-b9a6-4472-871b-b6553fedc750', '32e0ff1d-1f90-4dd8-8182-fe77746db708', '4168951c-6ce1-4227-91d6-ddf350313461'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:45 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e" returned: 0 in 0.407s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:45 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:45 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:45 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:45 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:45 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-97129519-e182-43e8-baa7-3c4c9431ca1e" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-97129519-e182-43e8-baa7-3c4c9431ca1e" released by "delete_volume" :: held 0.738s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:45 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.295s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d76e1562-a630-41db-ad2a-fbde3373a26e tempest-GroupsTest-663586737 None] Delete group completed successfully. Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Created reservations ['ff6c4d02-b7b8-4a05-b87d-cec522fc9c9c', '6d1519c8-1383-431b-a82f-381433d1efcc', '5c8971a1-3029-4c65-8c3d-70b2092e2444', 'be461383-2ccd-40cc-b7ed-9526d75f554c'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:45 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:45 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-ef9bfaef-4378-4974-b047-b3a6bc829d85-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Lock "cinder-ef9bfaef-4378-4974-b047-b3a6bc829d85-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:46 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:46 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Deleted volume successfully. Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7384a50c-90f8-4f49-ac20-11b5c4951277 tempest-VolumesGetTest-888641254 None] Lock "cinder-97129519-e182-43e8-baa7-3c4c9431ca1e-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-ef9bfaef-4378-4974-b047-b3a6bc829d85" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-ef9bfaef-4378-4974-b047-b3a6bc829d85" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd23b0d0-4c2b-4d05-b81c-7489e405d69b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:46 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 Jul 22 20:45:46 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:46 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85" returned: 0 in 0.413s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:46 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85 Jul 22 20:45:46 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:46 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ef9bfaef-4378-4974-b047-b3a6bc829d85" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-ef9bfaef-4378-4974-b047-b3a6bc829d85" released by "delete_volume" :: held 0.751s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:46 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Created reservations ['74d1d987-1be4-451a-9dfe-481a2452bba7', '2b16dce2-aec6-4b5d-8b82-000afea607fd', '6e46df84-3de4-4149-91de-7972fec96ff0', 'c9fba256-cbc6-4f10-bede-54d78fe22137'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:47 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:45:47 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:47 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.366s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:45:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Deleted volume successfully. Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-208eb1a8-43a8-4406-bddb-8ae1f7657ecb tempest-VolumesGetTest-888641254 None] Lock "cinder-ef9bfaef-4378-4974-b047-b3a6bc829d85-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:45:47 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (4382c659-4a6a-46dd-ae2b-4e492285d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8c9f8d-1f4b-4a40-993f-914aed0dc54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8c9f8d-1f4b-4a40-993f-914aed0dc54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1155790971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac6d500-8fee-4fb2-a87c-1045ebd74795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:48Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4655022e-fa7e-423b-8689-56d906eb7161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4655022e-fa7e-423b-8689-56d906eb7161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816096a5-4922-4b31-8a40-656f4cfda87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816096a5-4922-4b31-8a40-656f4cfda87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac6d500-8fee-4fb2-a87c-1045ebd74795', 'volume_name': 'volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677c627-913a-4506-ada0-5bfb13b47757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677c627-913a-4506-ada0-5bfb13b47757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954dc889-bd44-4a97-9656-ed1d1ec26019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:48 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Volume 1ac6d500-8fee-4fb2-a87c-1045ebd74795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795', 'volume_size': 1} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1155790971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac6d500-8fee-4fb2-a87c-1045ebd74795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:48Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Creating volume 1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:45:48 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:48 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 1073741824 Jul 22 20:45:48 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:48 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 1073741824" returned: 0 in 0.636s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:48 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 Jul 22 20:45:48 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Flow 'volume_create_manager' (ae8a86f8-9e3a-4319-81f5-25962940b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4984cf-63b3-480d-bd07-0f26f5c6ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4984cf-63b3-480d-bd07-0f26f5c6ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f87cea23c74249b37b1de70451b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:49Z,use_quota=True,user_id='78bc0eb9862c4f35b1da973ef10298e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a9c26-26c8-4edc-9c1b-168ba2ef4164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:49 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a9c26-26c8-4edc-9c1b-168ba2ef4164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d011f614-a3fd-4579-b44e-6787dbc52129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795" returned: 0 in 0.337s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954dc889-bd44-4a97-9656-ed1d1ec26019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23133cb1-aa54-434d-bd92-d7bbc0e68b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Volume volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 (1ac6d500-8fee-4fb2-a87c-1045ebd74795): created successfully Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23133cb1-aa54-434d-bd92-d7bbc0e68b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (4382c659-4a6a-46dd-ae2b-4e492285d718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cce2710c-ddf6-448a-81cc-01869265ebcc tempest-VolumesGetTest-888641254 None] Created volume successfully. Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d011f614-a3fd-4579-b44e-6787dbc52129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5', 'volume_name': 'volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5', 'volume_size': 1, 'image_id': 'be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11a48193ed199683eb1c70a5ffb1fdc8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0f87cea23c74249b37b1de70451b8d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '684075b2749d3da366d52031ba2dd9a53c91625adabb239907fb4540dd8e92a6b09492dd91a90429378c2d24e857006e8771646d6909de01fa907999c50fbb7c', 'id': 'be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'created_at': datetime.datetime(2026, 7, 22, 18, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 45, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b/file', 'properties': {}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f5601a-7a14-4c1e-9288-29489e1ae7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f5601a-7a14-4c1e-9288-29489e1ae7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1ba468-0299-47f3-a09d-00136be501ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Volume 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5', 'volume_size': 1, 'image_id': 'be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11a48193ed199683eb1c70a5ffb1fdc8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0f87cea23c74249b37b1de70451b8d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '684075b2749d3da366d52031ba2dd9a53c91625adabb239907fb4540dd8e92a6b09492dd91a90429378c2d24e857006e8771646d6909de01fa907999c50fbb7c', 'id': 'be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'created_at': datetime.datetime(2026, 7, 22, 18, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 45, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b/file', 'properties': {}}, 'image_service': } Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Trying to clone 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 from image be6b6fbd-edd2-4e7d-a20c-b4855a3f999b at location (None, [{'url': 'file:///opt/stack/data/glance/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:45:49 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Image download 0.00 MB at 0.00 MB/s Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce156f1-52be-4482-8385-cd0037da4689]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:49 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD Jul 22 20:45:49 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:50 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:50 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD Jul 22 20:45:50 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:50 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD" returned: 1 in 0.467s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:45:50 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Temporary image be6b6fbd-edd2-4e7d-a20c-b4855a3f999b is fetched for user 78bc0eb9862c4f35b1da973ef10298e0. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:45:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[309ce876-0851-426c-91de-17090853d64c]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:50 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD Jul 22 20:45:50 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (abb2015f-fbb2-406e-996e-81775966b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa17739-2d02-45ce-b3df-abe901321fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa17739-2d02-45ce-b3df-abe901321fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-52362556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1ac6d500-8fee-4fb2-a87c-1045ebd74795,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:51Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32452e7b-d11e-40f1-a185-b11908b44771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32452e7b-d11e-40f1-a185-b11908b44771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c81aa27-d86d-419b-b775-6d443684f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c81aa27-d86d-419b-b775-6d443684f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec', 'volume_name': 'volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec', 'volume_size': 1, 'source_volid': '1ac6d500-8fee-4fb2-a87c-1045ebd74795', 'source_volstatus': 'available'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:51 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a56b31f-1044-4d90-83a4-b8d927946cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a56b31f-1044-4d90-83a4-b8d927946cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc950bf-bc46-46fc-9366-7651fb822892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:45:51 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Volume 6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec', 'volume_size': 1, 'source_volid': '1ac6d500-8fee-4fb2-a87c-1045ebd74795', 'source_volstatus': 'available'} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:51 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Cloning volume 1ac6d500-8fee-4fb2-a87c-1045ebd74795 to volume 6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Creating offline snapshot 76ee1877-df47-4119-a569-04d64226b4ac of volume 1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29929f6-4815-4188-90b0-64ca1d413d8c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:51 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD Jul 22 20:45:51 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:51 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 Jul 22 20:45:51 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:51 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:51 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795" returned: 0 in 0.460s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:51 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac 1G Jul 22 20:45:51 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:52 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac 1G" returned: 0 in 0.477s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:52 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac Jul 22 20:45:52 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:52 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac" returned: 0 in 0.313s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:52 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac is being set with open permissions: ugo+rw Jul 22 20:45:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:52 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac Jul 22 20:45:52 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:52 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac" returned: 0 in 0.279s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:53 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.info Jul 22 20:45:53 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:53 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.info" returned: 0 in 0.376s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:53 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.info is being set with open permissions: ugo+rw Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:53 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.info Jul 22 20:45:53 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:53 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.info" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] snapshot: 76ee1877-df47-4119-a569-04d64226b4ac, volume: 6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f50714-d34d-4c16-8724-fc1c06b00a20]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:53 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac Jul 22 20:45:53 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:54 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac" returned: 0 in 0.380s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26a8e83-8fe6-44b2-87d0-faa30785b747]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:54 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 Jul 22 20:45:54 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:45:54 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795" returned: 0 in 0.531s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:45:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:45:54 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec Jul 22 20:45:54 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:00 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" returned: 0 in 5.729s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:00 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f6b58-8342-4e62-92a8-eaa5a6ba3480]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:00 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 Jul 22 20:46:00 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:01 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795" returned: 0 in 0.719s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:46:01 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Converted 1024.00 MB image at 178.69 MB/s Jul 22 20:46:01 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec is being set with open permissions: ugo+rw Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:01 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec Jul 22 20:46:01 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:01 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" returned: 0 in 0.306s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" released by "_copy_volume_from_snapshot" :: held 7.781s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-76ee1877-df47-4119-a569-04d64226b4ac" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-76ee1877-df47-4119-a569-04d64226b4ac" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Deleting offline snapshot 76ee1877-df47-4119-a569-04d64226b4ac of volume 1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] snapshot_file for this snap is: volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8bd2fd-2f22-4128-9fd8-563f7f1639cf]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:01 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac Jul 22 20:46:01 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:02 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac" returned: 0 in 0.507s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:46:02 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e401a485-91a0-4828-be0e-681143c9d674]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:02 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 Jul 22 20:46:02 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:02 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795" returned: 0 in 0.482s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:02 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac Jul 22 20:46:02 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:02 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=62,cinder:INSERT=23,cinder:UPDATE=94,cinder:DELETE=9 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:46:03 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac" returned: 0 in 0.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:03 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac Jul 22 20:46:03 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:03 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795.76ee1877-df47-4119-a569-04d64226b4ac" returned: 0 in 0.289s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-76ee1877-df47-4119-a569-04d64226b4ac" released by "_delete_snapshot" :: held 1.867s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.096s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.742s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f87cea23c74249b37b1de70451b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:45:49Z,use_quota=True,user_id='78bc0eb9862c4f35b1da973ef10298e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Creating volume 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:03 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc950bf-bc46-46fc-9366-7651fb822892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec', 'volume_size': 1, 'source_volid': '1ac6d500-8fee-4fb2-a87c-1045ebd74795', 'source_volstatus': 'available'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9077187-c3c5-4c05-9151-d22a5991ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:03 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 1073741824 Jul 22 20:46:03 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:03 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Volume volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec (6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec): created successfully Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9077187-c3c5-4c05-9151-d22a5991ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (abb2015f-fbb2-406e-996e-81775966b135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:03 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8ffa5752-e15e-4b78-8848-24d9adf7801d tempest-VolumesGetTest-888641254 None] Created volume successfully. Jul 22 20:46:04 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 1073741824" returned: 0 in 0.540s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:04 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 Jul 22 20:46:04 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:04 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Attempting download of be6b6fbd-edd2-4e7d-a20c-b4855a3f999b ((None, [{'url': 'file:///opt/stack/data/glance/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'metadata': {}}])) to volume 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5abd3bb-7548-4790-b2e1-0f5d1cf3e8bf]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_boxcgp6t {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:04 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_boxcgp6t Jul 22 20:46:04 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:04 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_boxcgp6t" returned: 0 in 0.367s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_boxcgp6t {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:05 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_boxcgp6t Jul 22 20:46:05 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:05 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_boxcgp6t" returned: 1 in 0.421s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_boxcgp6t' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ba12f0-109a-4e31-8139-5676553743d2]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (1676c283-c5b3-498e-8785-fb4f1d94fed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128d97ad-c80e-478d-a1f0-4d09aaa4bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:05 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128d97ad-c80e-478d-a1f0-4d09aaa4bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-641827251',display_name='tempest-VolumesGetTest-Volume-722863430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:05Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:05 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b56f377-178f-4e9b-85cd-c6aa15b41aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b56f377-178f-4e9b-85cd-c6aa15b41aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2123391-f8cc-4bc9-9d73-c4565e1c9440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2123391-f8cc-4bc9-9d73-c4565e1c9440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1', 'volume_name': 'volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e42270-6d25-4306-9136-7d923e6f7e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e42270-6d25-4306-9136-7d923e6f7e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ecc7c2-88a1-4781-8bce-03b4dc78dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Volume a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1', 'volume_size': 1} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-641827251',display_name='tempest-VolumesGetTest-Volume-722863430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:05Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Creating volume a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:05 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:05 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 1073741824 Jul 22 20:46:05 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:05 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:05 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD Jul 22 20:46:05 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:06 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 1073741824" returned: 0 in 0.586s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:06 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD" returned: 1 in 0.432s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] be6b6fbd-edd2-4e7d-a20c-b4855a3f999b was raw, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:06 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 Jul 22 20:46:06 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:06 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 Jul 22 20:46:06 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:06 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1" returned: 0 in 0.348s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ecc7c2-88a1-4781-8bce-03b4dc78dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d82d00c-d90e-4dbe-b8d0-2e019c43de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:06 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Volume volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 (a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1): created successfully Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d82d00c-d90e-4dbe-b8d0-2e019c43de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (1676c283-c5b3-498e-8785-fb4f1d94fed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:06 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4f64b715-176c-4f2c-83a3-c3c7221b54a6 tempest-VolumesGetTest-888641254 None] Created volume successfully. Jul 22 20:46:06 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5" returned: 0 in 0.634s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be6b6fbd-edd2-4e7d-a20c-b4855a3f999b_55935k44devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:46:06 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 20:46:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:06 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 1G Jul 22 20:46:06 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:07 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 1G" returned: 0 in 0.396s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Downloaded image be6b6fbd-edd2-4e7d-a20c-b4855a3f999b ((None, [{'url': 'file:///opt/stack/data/glance/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'metadata': {}}])) to volume 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Temporary image be6b6fbd-edd2-4e7d-a20c-b4855a3f999b for user 78bc0eb9862c4f35b1da973ef10298e0 is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Marking volume 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Copying metadata from image be6b6fbd-edd2-4e7d-a20c-b4855a3f999b to 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Creating volume glance metadata for volume 40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 backed by image be6b6fbd-edd2-4e7d-a20c-b4855a3f999b with: {'image_id': 'be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '11a48193ed199683eb1c70a5ffb1fdc8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1ba468-0299-47f3-a09d-00136be501ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5', 'volume_size': 1, 'image_id': 'be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11a48193ed199683eb1c70a5ffb1fdc8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0f87cea23c74249b37b1de70451b8d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '684075b2749d3da366d52031ba2dd9a53c91625adabb239907fb4540dd8e92a6b09492dd91a90429378c2d24e857006e8771646d6909de01fa907999c50fbb7c', 'id': 'be6b6fbd-edd2-4e7d-a20c-b4855a3f999b', 'created_at': datetime.datetime(2026, 7, 22, 18, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 45, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be6b6fbd-edd2-4e7d-a20c-b4855a3f999b/file', 'properties': {}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9bed6f-c913-41e3-bdf5-9bf29e3aa33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:07 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Volume volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 (40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5): created successfully Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9bed6f-c913-41e3-bdf5-9bf29e3aa33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Flow 'volume_create_manager' (ae8a86f8-9e3a-4319-81f5-25962940b010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7b082dc6-1d10-43d9-a914-2ea39208b751 tempest-VolumeImageDependencyTests-866330897 None] Created volume successfully. Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Lock "cinder-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd08cbe-6da8-44c0-a300-d0771e9b4b29]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:07 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 Jul 22 20:46:07 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Acquiring lock "cinder-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Lock "cinder-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Acquiring lock "cinder-quobyte-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Lock "cinder-quobyte-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5" acquired by "delete_volume" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd2738-d9f1-43fa-81b4-b1df8496adb8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:08 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 Jul 22 20:46:08 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:08 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1" returned: 0 in 0.552s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:08 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1 Jul 22 20:46:08 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:08 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1" returned: 0 in 0.397s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1" released by "delete_volume" :: held 1.029s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:08 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5" returned: 0 in 0.667s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:08 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5 Jul 22 20:46:08 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Created reservations ['6b1b9a91-89dc-4eea-b067-6c244211b394', '51662f29-9fa4-4701-9a4c-a912085dac64', '419cb711-b51d-4d2d-b80c-052ad386c3b9', '58a34f3f-f859-429e-be87-4f57ea950d3a'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:08 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:08 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:09 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5" returned: 0 in 0.342s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Lock "cinder-quobyte-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5" released by "delete_volume" :: held 1.074s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:09 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.327s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Deleted volume successfully. Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Created reservations ['e4c25f24-ac0b-4d75-ae6a-62b89f6cfee6', '14d18730-3b8a-43ce-8d0b-1b38242731c8', '19b60cd4-f21b-4990-8d52-e65da1a82dd4', '4cb39277-85e7-4e82-a168-f6c32b7b6b20'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d4f7648d-6ccb-4196-befb-0773f93590f4 tempest-VolumesGetTest-888641254 None] Lock "cinder-a83bbc79-77c0-4ad6-ad2e-f0b1636ed7a1-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:09 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:09 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:09 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.362s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Deleted volume successfully. Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-75eea8f7-50e6-4560-b106-7d8d50dcba36 tempest-VolumeImageDependencyTests-866330897 None] Lock "cinder-40737e3a-f32a-4dcb-9b23-dc46ad1c2ea5-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Lock "cinder-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce5e68-c68f-4019-9d02-77e160461a51]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:10 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec Jul 22 20:46:10 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:10 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" returned: 0 in 0.595s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:10 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec Jul 22 20:46:10 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:11 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" returned: 0 in 0.479s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec" released by "delete_volume" :: held 1.143s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Created reservations ['b00eec45-2f10-4cd5-992c-4a92a739b924', 'a8ad6cf6-8bd5-4c7f-b714-b6412c78d0f3', 'beac5485-8d20-4047-9734-92f30287d127', '67a52f1a-5d26-4792-b6af-666d3f35b7e1'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:11 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:11 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:11 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Deleted volume successfully. Jul 22 20:46:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-36c1661f-d3a4-4b8e-aa81-1b11eb20a2ca tempest-VolumesGetTest-888641254 None] Lock "cinder-6d7b6733-abb5-4fb3-a1cf-9aa8aaddf6ec-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Flow 'volume_create_manager' (d9944b1b-c1d7-479b-99d2-f7126ae6a28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1916ad-9881-410c-b33b-8daa477c39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1916ad-9881-410c-b33b-8daa477c39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-726096218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50440ee9-6366-4973-9ffa-30c46d630324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1731ed8b2704b8fbbe1f04656384393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:12Z,use_quota=True,user_id='43cd26eddcd74eb2bc6d9387b795e23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eda15046-81a0-4688-8842-c38c2653fa84),volume_type_id=eda15046-81a0-4688-8842-c38c2653fa84)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8241a12f-3a23-4c32-adf2-6ca4ada301d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8241a12f-3a23-4c32-adf2-6ca4ada301d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e81ef2-5e39-422f-b1a7-960fd4e549d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e81ef2-5e39-422f-b1a7-960fd4e549d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50440ee9-6366-4973-9ffa-30c46d630324', 'volume_name': 'volume-50440ee9-6366-4973-9ffa-30c46d630324', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9d3c37-35f3-4f94-b2cb-06a9f64de287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9d3c37-35f3-4f94-b2cb-06a9f64de287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c8f3f2-2db7-4e7e-a3ac-7c8b210ce6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Volume 50440ee9-6366-4973-9ffa-30c46d630324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50440ee9-6366-4973-9ffa-30c46d630324', 'volume_size': 1} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-726096218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50440ee9-6366-4973-9ffa-30c46d630324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1731ed8b2704b8fbbe1f04656384393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:12Z,use_quota=True,user_id='43cd26eddcd74eb2bc6d9387b795e23a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eda15046-81a0-4688-8842-c38c2653fa84),volume_type_id=eda15046-81a0-4688-8842-c38c2653fa84)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Creating volume 50440ee9-6366-4973-9ffa-30c46d630324 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:12 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:12 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 1073741824 Jul 22 20:46:12 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-1ac6d500-8fee-4fb2-a87c-1045ebd74795-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Lock "cinder-1ac6d500-8fee-4fb2-a87c-1045ebd74795-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-1ac6d500-8fee-4fb2-a87c-1045ebd74795" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-1ac6d500-8fee-4fb2-a87c-1045ebd74795" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a38b0a-a309-40b0-8084-052472311ef7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:12 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 Jul 22 20:46:12 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:12 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 1073741824" returned: 0 in 0.632s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:12 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 Jul 22 20:46:12 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:13 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795" returned: 0 in 0.469s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:13 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795 Jul 22 20:46:13 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:13 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324" returned: 0 in 0.359s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c8f3f2-2db7-4e7e-a3ac-7c8b210ce6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50440ee9-6366-4973-9ffa-30c46d630324', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4fe840-59da-4868-8bf3-20c619e7a40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Volume volume-50440ee9-6366-4973-9ffa-30c46d630324 (50440ee9-6366-4973-9ffa-30c46d630324): created successfully Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4fe840-59da-4868-8bf3-20c619e7a40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Flow 'volume_create_manager' (d9944b1b-c1d7-479b-99d2-f7126ae6a28b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-817359b9-4b68-41b7-99fa-8c404d46c2c9 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Created volume successfully. Jul 22 20:46:13 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1ac6d500-8fee-4fb2-a87c-1045ebd74795" returned: 0 in 0.331s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-1ac6d500-8fee-4fb2-a87c-1045ebd74795" released by "delete_volume" :: held 0.880s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Created reservations ['7678af4d-bb0a-4138-96d5-9bb95bdb1dba', 'c65dc67c-79fe-4d62-af99-ed1b7a3a70ed', 'f2446206-6fb0-477b-b1b9-2d1474cd0ccd', '2a788751-93ad-438b-95e0-762eaae6dedc'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:13 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:13 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:14 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.403s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Deleted volume successfully. Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-87504eb6-1238-4cfc-8854-f033365a9cc8 tempest-VolumesGetTest-888641254 None] Lock "cinder-1ac6d500-8fee-4fb2-a87c-1045ebd74795-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (77b4a53b-3782-4273-9969-11ee3c84bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb52df5-e15c-4b32-9481-ae83aaf94266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb52df5-e15c-4b32-9481-ae83aaf94266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-628526563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097222aa-a74a-44eb-82e1-656daab7ffb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:15Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b11435-b16f-4aa5-b98c-e49bebbce913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b11435-b16f-4aa5-b98c-e49bebbce913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84109ea-a4bb-4d9c-aad1-9ff305a2ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:46:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:15 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:15 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:15 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.363s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84109ea-a4bb-4d9c-aad1-9ff305a2ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '097222aa-a74a-44eb-82e1-656daab7ffb2', 'volume_name': 'volume-097222aa-a74a-44eb-82e1-656daab7ffb2', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e28da6b-32b0-4ebd-84cd-534336a94006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e28da6b-32b0-4ebd-84cd-534336a94006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7254233e-240c-4300-93cb-d5e6d929c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:15 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Volume 097222aa-a74a-44eb-82e1-656daab7ffb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-097222aa-a74a-44eb-82e1-656daab7ffb2', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Trying to clone 097222aa-a74a-44eb-82e1-656daab7ffb2 from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:46:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0103a067-94a3-4e1d-810f-fae5d125c6c6 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Retype volume completed successfully. Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:46:15 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Image download 20.69 MB at 20.69 MB/s Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Flow 'volume_create_manager' (ff2c4507-6b9e-4e20-aca1-e171c90f27ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed95dfaa-f491-48bf-82b0-903a10500833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed95dfaa-f491-48bf-82b0-903a10500833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2136907798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469386a2-c4c7-4b1b-a7cd-6b9cd8879397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc2b64b34cd4c97bcd64ca01baaf647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:16Z,use_quota=True,user_id='a0a1d72fe79e43cb92fb231ed68d43ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad22f3e-7468-4e03-891b-d0811c417df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad22f3e-7468-4e03-891b-d0811c417df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759bed11-b0d3-4f97-a51d-4d92e0243a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759bed11-b0d3-4f97-a51d-4d92e0243a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469386a2-c4c7-4b1b-a7cd-6b9cd8879397', 'volume_name': 'volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8aa4c1-2243-4758-bdcb-337c1ba2338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8aa4c1-2243-4758-bdcb-337c1ba2338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c18b23b-c2d7-444e-859a-b53deb5104de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:15 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Volume 469386a2-c4c7-4b1b-a7cd-6b9cd8879397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397', 'volume_size': 1} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2136907798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469386a2-c4c7-4b1b-a7cd-6b9cd8879397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc2b64b34cd4c97bcd64ca01baaf647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:16Z,use_quota=True,user_id='a0a1d72fe79e43cb92fb231ed68d43ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Creating volume 469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:15 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa31cbb-6ff0-4f73-8996-abe78235550b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:15 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 1073741824 Jul 22 20:46:15 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Flow 'volume_create_manager' (054c96f7-4f45-4cbd-85d9-670504ba3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca034391-bb41-4816-be4e-5d1baa0b6a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca034391-bb41-4816-be4e-5d1baa0b6a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620422263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e626d816-043a-49b5-9165-680d16f568e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf94c2cbb541ed8dad80b1ac03b6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:16Z,use_quota=True,user_id='3ceae726ad9d4714b2dcd0840ed17c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98c4e46-e387-4de2-9297-32b157bf5876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98c4e46-e387-4de2-9297-32b157bf5876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11be60de-0cec-4560-8ce9-1f8733bf674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11be60de-0cec-4560-8ce9-1f8733bf674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e626d816-043a-49b5-9165-680d16f568e1', 'volume_name': 'volume-e626d816-043a-49b5-9165-680d16f568e1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d6a198-674c-4e07-9379-a3021f49dfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d6a198-674c-4e07-9379-a3021f49dfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a7dd8e-3c20-47c1-bdd6-80b3eea8776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:16 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Volume e626d816-043a-49b5-9165-680d16f568e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e626d816-043a-49b5-9165-680d16f568e1', 'volume_size': 1} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:16 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD Jul 22 20:46:16 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Acquiring lock "cinder-50440ee9-6366-4973-9ffa-30c46d630324-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "cinder-50440ee9-6366-4973-9ffa-30c46d630324-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Acquiring lock "cinder-quobyte-50440ee9-6366-4973-9ffa-30c46d630324" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "cinder-quobyte-50440ee9-6366-4973-9ffa-30c46d630324" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5110ce69-01a9-4c6c-a7c8-76c4d779f56d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:16 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 is fetched for user 258c55e964274afc9925ef48c0826cca. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:46:16 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 Jul 22 20:46:16 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:16 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 1073741824" returned: 0 in 0.507s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e562cbf6-eea1-429a-9bdd-177cfc77573e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:16 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 Jul 22 20:46:16 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:16 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD Jul 22 20:46:16 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:16 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324" returned: 0 in 0.400s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:16 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324 Jul 22 20:46:16 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:16 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620422263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e626d816-043a-49b5-9165-680d16f568e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf94c2cbb541ed8dad80b1ac03b6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:16Z,use_quota=True,user_id='3ceae726ad9d4714b2dcd0840ed17c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Creating volume e626d816-043a-49b5-9165-680d16f568e1 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:16 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:16 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 1073741824 Jul 22 20:46:16 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:16 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c18b23b-c2d7-444e-859a-b53deb5104de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202e955a-80b2-456e-bcb6-039e3f82eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:16 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Volume volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 (469386a2-c4c7-4b1b-a7cd-6b9cd8879397): created successfully Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202e955a-80b2-456e-bcb6-039e3f82eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Flow 'volume_create_manager' (ff2c4507-6b9e-4e20-aca1-e171c90f27ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-dff9a774-2331-4972-953f-d59c0553010a tempest-SnapshotDependencyTests-957840085 None] Created volume successfully. Jul 22 20:46:16 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50440ee9-6366-4973-9ffa-30c46d630324" returned: 0 in 0.272s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "cinder-quobyte-50440ee9-6366-4973-9ffa-30c46d630324" released by "delete_volume" :: held 0.719s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:16 devstack cinder-volume[87818]: WARNING cinder.quota [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:46:16 devstack cinder-volume[87818]: WARNING cinder.quota [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Created reservations ['591b132e-4dbf-4af0-bd27-c4fb8ad7b31e', 'dd1eb665-9d72-497f-a14f-fe37c122a40f', 'c1d64fde-6095-4c35-9a3a-6d03acc419b3', '31717ac7-ff0f-4f8c-865a-4841848fa4d7'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:17 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:17 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:17 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 1073741824" returned: 0 in 0.415s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:17 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 Jul 22 20:46:17 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:17 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.265s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Deleted volume successfully. Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5bbd11df-8920-47e7-9dfd-ab6e437c9c61 tempest-VolumeRetypeWithoutMigrationTest-1034551333 None] Lock "cinder-50440ee9-6366-4973-9ffa-30c46d630324-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:17 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-628526563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097222aa-a74a-44eb-82e1-656daab7ffb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:15Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Creating volume 097222aa-a74a-44eb-82e1-656daab7ffb2 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:17 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:17 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 1073741824 Jul 22 20:46:17 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a7dd8e-3c20-47c1-bdd6-80b3eea8776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e626d816-043a-49b5-9165-680d16f568e1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a36f9a-90c4-4f03-8bd4-bc288e98f5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:17 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Volume volume-e626d816-043a-49b5-9165-680d16f568e1 (e626d816-043a-49b5-9165-680d16f568e1): created successfully Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a36f9a-90c4-4f03-8bd4-bc288e98f5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Flow 'volume_create_manager' (054c96f7-4f45-4cbd-85d9-670504ba3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-fe558598-91fa-48bb-ab09-de234998ae06 tempest-ProjectReaderTests-369343046 None] Created volume successfully. Jul 22 20:46:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:18 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 1073741824" returned: 0 in 0.532s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:18 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 Jul 22 20:46:18 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:18 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.411s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Creating offline snapshot bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b of volume 469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d117d2c1-f02d-48a2-9bf7-9e81c47823b1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Attempting download of 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume 097222aa-a74a-44eb-82e1-656daab7ffb2. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[448c2ae0-fd03-407f-8b70-6fee86c622a4]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_t0l9c56c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:18 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 Jul 22 20:46:18 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:18 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_t0l9c56c Jul 22 20:46:18 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:18 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" returned: 0 in 0.442s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:18 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_t0l9c56c" returned: 0 in 0.376s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_t0l9c56c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:18 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b 1G Jul 22 20:46:18 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:19 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_t0l9c56c Jul 22 20:46:19 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Acquiring lock "cinder-e626d816-043a-49b5-9165-680d16f568e1-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Lock "cinder-e626d816-043a-49b5-9165-680d16f568e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Acquiring lock "cinder-quobyte-e626d816-043a-49b5-9165-680d16f568e1" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Lock "cinder-quobyte-e626d816-043a-49b5-9165-680d16f568e1" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b41f0e7-5702-4cf5-9877-6ae33222cbf4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:19 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_t0l9c56c" returned: 1 in 0.541s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36543c2a-70aa-4e05-bb91-fc14ca93a149_t0l9c56c' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[39788a9a-4a9e-470d-8d91-dbb84986c991]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:19 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b 1G" returned: 0 in 0.593s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:19 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b Jul 22 20:46:19 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:19 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 Jul 22 20:46:19 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:19 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD Jul 22 20:46:19 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:19 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:19 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" returned: 0 in 0.338s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:19 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b is being set with open permissions: ugo+rw Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1" returned: 0 in 0.476s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:19 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b Jul 22 20:46:19 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:19 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1 Jul 22 20:46:19 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:19 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] 36543c2a-70aa-4e05-bb91-fc14ca93a149 was qcow2, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:46:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:19 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 Jul 22 20:46:19 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:20 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" returned: 0 in 0.286s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:20 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e626d816-043a-49b5-9165-680d16f568e1" returned: 0 in 0.308s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Lock "cinder-quobyte-e626d816-043a-49b5-9165-680d16f568e1" released by "delete_volume" :: held 0.869s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:20 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.info Jul 22 20:46:20 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Created reservations ['e8a79d87-3e73-4f5d-a640-7af955989a02', '60a15af9-7948-43a0-96f9-0f545adaabef', '520929b9-0860-4fa3-9017-5c20cb473323', 'b93d07ef-6fad-4e01-9518-eed99ada201c'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:20 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:20 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:20 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.info" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:20 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.info is being set with open permissions: ugo+rw Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:20 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.info Jul 22 20:46:20 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:20 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.341s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:20 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Deleted volume successfully. Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4438f0d2-0432-4b54-af41-9c36264d63e9 tempest-ProjectReaderTests-369343046 None] Lock "cinder-e626d816-043a-49b5-9165-680d16f568e1-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:20 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.info" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:20 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b765af65-b40d-4ddb-8af3-92f8903065ed tempest-SnapshotDependencyTests-957840085 None] Create snapshot completed successfully Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Flow 'volume_create_manager' (6ce92b42-052b-4339-b288-ce8837a1de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36938867-a4c6-4b4f-99f8-3f9f2aea1aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36938867-a4c6-4b4f-99f8-3f9f2aea1aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240319255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0928a5-d210-4af0-a325-fe4e25ff9f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf94c2cbb541ed8dad80b1ac03b6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:21Z,use_quota=True,user_id='3ceae726ad9d4714b2dcd0840ed17c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0eef69c-af9d-4a3e-8978-b99ff19dd57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0eef69c-af9d-4a3e-8978-b99ff19dd57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2113b785-ca60-46eb-8dfa-4565ebb7cff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2113b785-ca60-46eb-8dfa-4565ebb7cff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0928a5-d210-4af0-a325-fe4e25ff9f10', 'volume_name': 'volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8098987f-0191-4e51-acea-e3d7f81a0711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8098987f-0191-4e51-acea-e3d7f81a0711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a061c5e2-2b83-462f-a7a4-6e1acd814489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:21 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Volume fc0928a5-d210-4af0-a325-fe4e25ff9f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10', 'volume_size': 1} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240319255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0928a5-d210-4af0-a325-fe4e25ff9f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbf94c2cbb541ed8dad80b1ac03b6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:21Z,use_quota=True,user_id='3ceae726ad9d4714b2dcd0840ed17c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Creating volume fc0928a5-d210-4af0-a325-fe4e25ff9f10 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:21 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:21 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 1073741824 Jul 22 20:46:21 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:21 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 1073741824" returned: 0 in 0.580s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:21 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 Jul 22 20:46:21 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:21 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Flow 'volume_create_manager' (8de3b6d4-ead2-4919-8271-1f21843ddd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8b1a7e-d6b1-4e1c-8142-388259dbb42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8b1a7e-d6b1-4e1c-8142-388259dbb42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157cfac1-4039-4fbd-b368-9826aa9a7547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc2b64b34cd4c97bcd64ca01baaf647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:22Z,use_quota=True,user_id='a0a1d72fe79e43cb92fb231ed68d43ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f21994b-8d92-4cb8-b2cc-6eac5438d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f21994b-8d92-4cb8-b2cc-6eac5438d95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecce476-1464-4866-9e34-b65a0355fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecce476-1464-4866-9e34-b65a0355fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '157cfac1-4039-4fbd-b368-9826aa9a7547', 'volume_name': 'volume-157cfac1-4039-4fbd-b368-9826aa9a7547', 'volume_size': 1, 'snapshot_id': 'bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37379617-ae5a-44c8-80e3-f32376487770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37379617-ae5a-44c8-80e3-f32376487770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6f373b-782e-463e-aa96-82485ce99374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:22 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Volume 157cfac1-4039-4fbd-b368-9826aa9a7547: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-157cfac1-4039-4fbd-b368-9826aa9a7547', 'volume_size': 1, 'snapshot_id': 'bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b'} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:22 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.091s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-quobyte-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b-157cfac1-4039-4fbd-b368-9826aa9a7547" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a061c5e2-2b83-462f-a7a4-6e1acd814489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec076959-ed23-4216-889c-2e43abb0cbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b-157cfac1-4039-4fbd-b368-9826aa9a7547" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Creating volume 157cfac1-4039-4fbd-b368-9826aa9a7547 from snapshot bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-quobyte-157cfac1-4039-4fbd-b368-9826aa9a7547" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:22 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Volume volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 (fc0928a5-d210-4af0-a325-fe4e25ff9f10): created successfully Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec076959-ed23-4216-889c-2e43abb0cbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Flow 'volume_create_manager' (6ce92b42-052b-4339-b288-ce8837a1de0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2" returned: 0 in 2.366s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36543c2a-70aa-4e05-bb91-fc14ca93a149_x7yjp7yudevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:46:22 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Converted 112.00 MB image at 47.32 MB/s Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-157cfac1-4039-4fbd-b368-9826aa9a7547" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] snapshot: bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b, volume: 157cfac1-4039-4fbd-b368-9826aa9a7547, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:46:22 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 1G Jul 22 20:46:22 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ef6ae082-c671-4323-a4ae-1b15a488171a tempest-ProjectReaderTests-369343046 None] Created volume successfully. Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5a2a0b-ae54-4fc6-9bd3-736478ea8b17]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:22 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b Jul 22 20:46:22 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:22 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 1G" returned: 0 in 0.358s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Downloaded image 36543c2a-70aa-4e05-bb91-fc14ca93a149 ((None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}])) to volume 097222aa-a74a-44eb-82e1-656daab7ffb2 successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Temporary image 36543c2a-70aa-4e05-bb91-fc14ca93a149 for user 258c55e964274afc9925ef48c0826cca is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Marking volume 097222aa-a74a-44eb-82e1-656daab7ffb2 as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Copying metadata from image 36543c2a-70aa-4e05-bb91-fc14ca93a149 to 097222aa-a74a-44eb-82e1-656daab7ffb2. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Creating volume glance metadata for volume 097222aa-a74a-44eb-82e1-656daab7ffb2 backed by image 36543c2a-70aa-4e05-bb91-fc14ca93a149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7254233e-240c-4300-93cb-d5e6d929c737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097222aa-a74a-44eb-82e1-656daab7ffb2', 'volume_size': 1, 'image_id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36543c2a-70aa-4e05-bb91-fc14ca93a149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '160bb183e0cd45219309bc719ee5e5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36543c2a-70aa-4e05-bb91-fc14ca93a149', 'created_at': datetime.datetime(2026, 7, 22, 18, 29, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36543c2a-70aa-4e05-bb91-fc14ca93a149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899ef3a1-0a0a-47ac-8008-b0b40df48599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:22 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" returned: 0 in 0.396s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:46:22 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Volume volume-097222aa-a74a-44eb-82e1-656daab7ffb2 (097222aa-a74a-44eb-82e1-656daab7ffb2): created successfully Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899ef3a1-0a0a-47ac-8008-b0b40df48599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (77b4a53b-3782-4273-9969-11ee3c84bce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d66a04d-f3a2-4fd3-9597-bea345fa7485]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-49360302-c745-4117-bb26-462e9e0af397 tempest-VolumesGetTest-888641254 None] Created volume successfully. Jul 22 20:46:22 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 Jul 22 20:46:22 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Acquiring lock "cinder-fc0928a5-d210-4af0-a325-fe4e25ff9f10-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:23 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" returned: 0 in 0.419s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Lock "cinder-fc0928a5-d210-4af0-a325-fe4e25ff9f10-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:23 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 Jul 22 20:46:23 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Acquiring lock "cinder-quobyte-fc0928a5-d210-4af0-a325-fe4e25ff9f10" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Lock "cinder-quobyte-fc0928a5-d210-4af0-a325-fe4e25ff9f10" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84426b5-6b1f-4844-b679-a280378b64af]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:23 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 Jul 22 20:46:23 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:23 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10" returned: 0 in 0.579s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:24 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10 Jul 22 20:46:24 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:24 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fc0928a5-d210-4af0-a325-fe4e25ff9f10" returned: 0 in 0.871s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Lock "cinder-quobyte-fc0928a5-d210-4af0-a325-fe4e25ff9f10" released by "delete_volume" :: held 1.546s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:24 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (36387633-e355-4c24-bf45-3e8aa8b68420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef317d49-5363-4f92-b32e-a780b037103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef317d49-5363-4f92-b32e-a780b037103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-448539531',display_name='tempest-VolumesGetTest-Volume-89816257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:25Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78138ee-35af-4043-91f7-8b2f13a19cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78138ee-35af-4043-91f7-8b2f13a19cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f982e6-ac51-4a26-89c3-39b0cb438ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f982e6-ac51-4a26-89c3-39b0cb438ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4', 'volume_name': 'volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc947b5-fcf7-49ff-9c74-44620b5fc7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc947b5-fcf7-49ff-9c74-44620b5fc7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9409a4-c3bf-4149-b00c-2930e2e86533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Volume 3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4', 'volume_size': 1} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Created reservations ['cf6188f5-3ee3-4eb4-a904-f7b93732ff47', 'aed39fbc-b98f-4d3e-9ef7-930300921544', 'dff084c4-a28a-44c2-a8ab-f0220325a25d', 'c919f3a4-cb6f-4176-a4fe-b9ae14fb5cbf'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:25 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:25 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:26 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.625s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:26 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Deleted volume successfully. Jul 22 20:46:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8b0295bf-4bdc-4f85-8592-0bf15619f143 tempest-ProjectReaderTests-369343046 None] Lock "cinder-fc0928a5-d210-4af0-a325-fe4e25ff9f10-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:29 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547" returned: 0 in 6.051s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ebc60-6255-4ac4-bf86-3fdb957e79f8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:29 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 Jul 22 20:46:29 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:29 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" returned: 0 in 0.679s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:29 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:46:29 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Converted 1024.00 MB image at 169.19 MB/s Jul 22 20:46:29 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 is being set with open permissions: ugo+rw Jul 22 20:46:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:30 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 Jul 22 20:46:30 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:30 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-157cfac1-4039-4fbd-b368-9826aa9a7547" released by "_copy_volume_from_snapshot" :: held 7.939s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b-157cfac1-4039-4fbd-b368-9826aa9a7547" released by "_create_volume_from_snapshot" :: held 8.026s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.060s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.073s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-448539531',display_name='tempest-VolumesGetTest-Volume-89816257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f08c1fc3cf415487b4739cbdab49a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:25Z,use_quota=True,user_id='258c55e964274afc9925ef48c0826cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Creating volume 3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:30 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:30 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 1073741824 Jul 22 20:46:30 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6f373b-782e-463e-aa96-82485ce99374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157cfac1-4039-4fbd-b368-9826aa9a7547', 'volume_size': 1, 'snapshot_id': 'bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37556287-907f-4a70-90af-9a9e83f968a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:30 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Volume volume-157cfac1-4039-4fbd-b368-9826aa9a7547 (157cfac1-4039-4fbd-b368-9826aa9a7547): created successfully Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37556287-907f-4a70-90af-9a9e83f968a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Flow 'volume_create_manager' (8de3b6d4-ead2-4919-8271-1f21843ddd9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-80826e70-b422-48bb-8570-4e55042dc26c tempest-SnapshotDependencyTests-957840085 None] Created volume successfully. Jul 22 20:46:30 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 1073741824" returned: 0 in 0.482s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:30 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 Jul 22 20:46:30 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-quobyte-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-quobyte-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Deleting offline snapshot bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b of volume 469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] snapshot_file for this snap is: volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:46:31 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4" returned: 0 in 0.345s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e5b9c8-160b-479e-83b2-1d957b5b9d6f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9409a4-c3bf-4149-b00c-2930e2e86533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac2c519-af83-4896-9cd3-4f33354badee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:31 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Volume volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 (3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4): created successfully Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac2c519-af83-4896-9cd3-4f33354badee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Flow 'volume_create_manager' (36387633-e355-4c24-bf45-3e8aa8b68420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a156c82d-0a10-473d-8fe1-8c7a0819df4e tempest-VolumesGetTest-888641254 None] Created volume successfully. Jul 22 20:46:31 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b Jul 22 20:46:31 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:31 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3e244d-8f64-4132-99b0-3a4685295595]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:31 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 Jul 22 20:46:31 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:32 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" returned: 0 in 0.414s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:32 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b Jul 22 20:46:32 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Lock "cinder-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:32 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" returned: 0 in 0.551s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a517ae-9e4f-491f-a8ef-6a40240dd2f6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:32 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b Jul 22 20:46:32 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:32 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 Jul 22 20:46:32 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:33 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397.bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" returned: 0 in 0.420s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b" released by "_delete_snapshot" :: held 1.974s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" released by "delete_snapshot" :: held 2.026s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Created reservations ['ecddccc0-b264-4587-8811-ca3ea092cf47', 'a2d1ceaa-6f45-43a4-a3b8-33b24f419eb1', '75e1431e-e4bf-46ab-a1fd-55483048a26e', '0f8ffb17-78af-4eed-ba47-3bfdd2862b37'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:33 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4" returned: 0 in 0.594s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:33 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4 Jul 22 20:46:33 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:33 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Delete snapshot completed successfully. Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a7011f2a-13d6-41d6-9f95-160e7e7a726e tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-bb6e1c5d-24aa-4ac0-9fb0-8fab8b5ffd4b-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:33 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4" released by "delete_volume" :: held 0.946s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Created reservations ['a96379b7-e206-4c6d-8d44-6ec549a77a16', '22b38439-bc52-46f6-aee1-67059312569f', '4b036af0-05b1-4854-9a01-82605f055d51', '8eedf5b9-f416-49a7-b200-c73b83982a25'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:33 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:33 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:33 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:33 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:33 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Deleted volume successfully. Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6620bd5-091f-4c63-9e46-f3c4302adf37 tempest-VolumesGetTest-888641254 None] Lock "cinder-3e30f9a3-18a6-4a45-bf9f-be6c8e9d12e4-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-469386a2-c4c7-4b1b-a7cd-6b9cd8879397-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-469386a2-c4c7-4b1b-a7cd-6b9cd8879397-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-quobyte-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24be710-c1b1-421a-bd2a-ca2c815ee9b7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:34 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 Jul 22 20:46:34 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:34 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" returned: 0 in 0.435s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-097222aa-a74a-44eb-82e1-656daab7ffb2-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:34 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397 Jul 22 20:46:34 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Lock "cinder-097222aa-a74a-44eb-82e1-656daab7ffb2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Acquiring lock "cinder-quobyte-097222aa-a74a-44eb-82e1-656daab7ffb2" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-097222aa-a74a-44eb-82e1-656daab7ffb2" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[51470b23-c11d-4c77-82a8-bf32a82e1a14]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:35 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 Jul 22 20:46:35 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:35 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" returned: 0 in 0.365s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-469386a2-c4c7-4b1b-a7cd-6b9cd8879397" released by "delete_volume" :: held 0.879s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Created reservations ['c4c8edb8-3bff-49b6-bd8b-8f112d4f93e7', '61ae34ff-0fb8-4ae5-947c-2aadc1c50677', '3a37ee1d-71ed-4a1d-8272-70065e3484cd', 'f3f6621a-bb11-47a9-a27f-cb9601797a8d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:35 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:35 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-157cfac1-4039-4fbd-b368-9826aa9a7547-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:35 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2" returned: 0 in 0.521s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-157cfac1-4039-4fbd-b368-9826aa9a7547-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:35 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2 Jul 22 20:46:35 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "cinder-quobyte-157cfac1-4039-4fbd-b368-9826aa9a7547" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-157cfac1-4039-4fbd-b368-9826aa9a7547" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb751535-4c5b-43e3-a50f-e47b35318e7c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:35 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.445s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:35 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 Jul 22 20:46:35 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Deleted volume successfully. Jul 22 20:46:35 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-097222aa-a74a-44eb-82e1-656daab7ffb2" returned: 0 in 0.360s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-42e9211a-2015-45f4-8549-d81173477744 tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-469386a2-c4c7-4b1b-a7cd-6b9cd8879397-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Lock "cinder-quobyte-097222aa-a74a-44eb-82e1-656daab7ffb2" released by "delete_volume" :: held 0.968s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Created reservations ['a1bdd3d1-3ef0-4884-b8de-61f51fa689d4', '0f333d20-2e25-4c7f-a134-d01290c22a45', '5cbe3fed-bab4-47df-83b1-22779dfe48ee', '2a67d757-dcb3-492c-b36a-eae644949b91'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:36 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547" returned: 0 in 0.530s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:36 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:36 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:36 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547 Jul 22 20:46:36 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:36 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.262s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Deleted volume successfully. Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-83f2af8e-3697-45e6-a0b1-397e6ffd6093 tempest-VolumesGetTest-888641254 None] Lock "cinder-097222aa-a74a-44eb-82e1-656daab7ffb2-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:36 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-157cfac1-4039-4fbd-b368-9826aa9a7547" returned: 0 in 0.287s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-quobyte-157cfac1-4039-4fbd-b368-9826aa9a7547" released by "delete_volume" :: held 0.863s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Created reservations ['1a04e01c-bffa-4e5b-bc5e-44f6ca511f07', '7795d074-2c90-48c1-ad99-109779b4fe3b', 'e034bb78-50a3-492b-bc06-a9b906792135', 'e4ee3e90-b1ed-407a-a839-77b931e826a9'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:36 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:36 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:36 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.259s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:36 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Deleted volume successfully. Jul 22 20:46:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b5028d83-9ad2-40cb-a313-1cc047e3ceef tempest-SnapshotDependencyTests-957840085 None] Lock "cinder-157cfac1-4039-4fbd-b368-9826aa9a7547-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:41 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:46:41 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:41 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:46:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:46:46 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=123,cinder:SELECT=110,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:46:46 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:DELETE=13,cinder:UPDATE=222,cinder:SELECT=161,cinder:INSERT=65 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (739ce3c3-534a-4261-b72e-015e6d2578fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd4b0e5-d5ef-45a8-91be-d16304ca12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd4b0e5-d5ef-45a8-91be-d16304ca12ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1621129769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc929abb-9197-4f39-8b00-2b140e3ff570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:57Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e799c-8d72-4dd0-b8e4-aace3f6a2da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e799c-8d72-4dd0-b8e4-aace3f6a2da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b67dbec-8459-4faf-9d97-4c0dfa5079c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b67dbec-8459-4faf-9d97-4c0dfa5079c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc929abb-9197-4f39-8b00-2b140e3ff570', 'volume_name': 'volume-cc929abb-9197-4f39-8b00-2b140e3ff570', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d179eca-8202-432f-a87d-44fb72661d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d179eca-8202-432f-a87d-44fb72661d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98316cb7-cdb2-4027-a1b7-1a81a8fec620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:57 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Volume cc929abb-9197-4f39-8b00-2b140e3ff570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc929abb-9197-4f39-8b00-2b140e3ff570', 'volume_size': 1} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1621129769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc929abb-9197-4f39-8b00-2b140e3ff570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:46:57Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Creating volume cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:46:57 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:57 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 1073741824 Jul 22 20:46:57 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:57 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 1073741824" returned: 0 in 0.700s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:57 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 Jul 22 20:46:57 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:58 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570" returned: 0 in 0.358s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:46:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:46:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98316cb7-cdb2-4027-a1b7-1a81a8fec620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc929abb-9197-4f39-8b00-2b140e3ff570', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ec0d50-ef8a-405c-979b-8a4dfeb6b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:46:58 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Volume volume-cc929abb-9197-4f39-8b00-2b140e3ff570 (cc929abb-9197-4f39-8b00-2b140e3ff570): created successfully Jul 22 20:46:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ec0d50-ef8a-405c-979b-8a4dfeb6b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:46:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (739ce3c3-534a-4261-b72e-015e6d2578fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:46:58 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bd2cd9a0-24ec-4587-9ca6-5db1ac00ffca tempest-VolumesSnapshotTestJSON-945850065 None] Created volume successfully. Jul 22 20:46:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:46:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:46:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Creating offline snapshot 161a2973-6324-4044-90cf-1fe7d991a8a7 of volume cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:46:59 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dda2568-8ba9-4c18-be98-984fb0d73284]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:46:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:59 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 Jul 22 20:46:59 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:46:59 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 22 20:46:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570" returned: 0 in 0.394s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:46:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:46:59 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 1G Jul 22 20:46:59 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:00 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 1G" returned: 0 in 0.526s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc929abb-9197-4f39-8b00-2b140e3ff570 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:00 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc929abb-9197-4f39-8b00-2b140e3ff570 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 Jul 22 20:47:00 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:00 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc929abb-9197-4f39-8b00-2b140e3ff570 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7" returned: 0 in 0.307s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:00 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 is being set with open permissions: ugo+rw Jul 22 20:47:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:00 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 Jul 22 20:47:00 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:01 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7" returned: 0 in 0.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:01 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.info Jul 22 20:47:01 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:01 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.info" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:01 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.info is being set with open permissions: ugo+rw Jul 22 20:47:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:01 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.info Jul 22 20:47:01 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:01 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.info" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:01 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a53c9a6d-2d4b-4912-bdde-478ccee1fb7f tempest-VolumesSnapshotTestJSON-945850065 None] Create snapshot completed successfully Jul 22 20:47:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-161a2973-6324-4044-90cf-1fe7d991a8a7-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-161a2973-6324-4044-90cf-1fe7d991a8a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-cc929abb-9197-4f39-8b00-2b140e3ff570" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cc929abb-9197-4f39-8b00-2b140e3ff570" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-161a2973-6324-4044-90cf-1fe7d991a8a7" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-161a2973-6324-4044-90cf-1fe7d991a8a7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Deleting offline snapshot 161a2973-6324-4044-90cf-1fe7d991a8a7 of volume cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] snapshot_file for this snap is: volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aafac3-d737-4283-9b77-461865b3315b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:03 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 Jul 22 20:47:03 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:03 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc929abb-9197-4f39-8b00-2b140e3ff570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b4824-221a-4a07-a802-12e30a98e090]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:03 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 Jul 22 20:47:03 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:03 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570" returned: 0 in 0.407s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:04 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 Jul 22 20:47:04 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:04 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7" returned: 0 in 0.382s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:04 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7 Jul 22 20:47:04 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:04 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570.161a2973-6324-4044-90cf-1fe7d991a8a7" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-161a2973-6324-4044-90cf-1fe7d991a8a7" released by "_delete_snapshot" :: held 1.622s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cc929abb-9197-4f39-8b00-2b140e3ff570" released by "delete_snapshot" :: held 1.649s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:04 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['490b4fd2-a53b-40a0-8146-8f2421987abe', 'df2d6bcb-77d4-4628-bf53-a1df5386553c', '2f809caa-ca90-4354-ae4e-f476b88780c3', '14f5e030-d111-418b-bede-36f789b1e4d2'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:04 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Delete snapshot completed successfully. Jul 22 20:47:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2e87ddd1-b002-4ddd-a607-6a40a94eacb0 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-161a2973-6324-4044-90cf-1fe7d991a8a7-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (ac5030c8-80f4-4d0f-9345-ac4b5184f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a223019b-c4f6-4f89-ab1f-c0896aec5859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a223019b-c4f6-4f89-ab1f-c0896aec5859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420248903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a5ef03-d7e6-4a9f-833a-1b395c26c96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:05Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ecdb81-7b90-4345-ad75-5bb5a6bab66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ecdb81-7b90-4345-ad75-5bb5a6bab66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa2d299-cf6c-4daa-877c-41269b001fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa2d299-cf6c-4daa-877c-41269b001fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a5ef03-d7e6-4a9f-833a-1b395c26c96f', 'volume_name': 'volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6645ad3-07fb-48fe-8944-7b4b684a50e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6645ad3-07fb-48fe-8944-7b4b684a50e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a5b8d2-4048-4669-9672-a5bffff5f226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Volume a4a5ef03-d7e6-4a9f-833a-1b395c26c96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f', 'volume_size': 1} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420248903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a5ef03-d7e6-4a9f-833a-1b395c26c96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:05Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Creating volume a4a5ef03-d7e6-4a9f-833a-1b395c26c96f {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:05 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:05 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f 1073741824 Jul 22 20:47:05 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (c32e22d9-a942-4ba6-aff3-a4d2ef235ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d92ed7-940a-45f4-b25a-0d2beb2f962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d92ed7-940a-45f4-b25a-0d2beb2f962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2124413315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff47b7ed-d730-4c2e-acd7-a671314bfee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:06Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10e657d-0fc3-480c-b7bb-160f88bfe037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10e657d-0fc3-480c-b7bb-160f88bfe037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15afc7aa-9e86-4e26-951d-bf4ff1b946c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15afc7aa-9e86-4e26-951d-bf4ff1b946c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff47b7ed-d730-4c2e-acd7-a671314bfee9', 'volume_name': 'volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b243fa6-3008-4bc3-aa7c-f8d477a2dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b243fa6-3008-4bc3-aa7c-f8d477a2dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ebd8fa-2fb8-408c-bc62-57510d22df8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Volume ff47b7ed-d730-4c2e-acd7-a671314bfee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9', 'volume_size': 1} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f 1073741824" returned: 0 in 0.527s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:05 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f Jul 22 20:47:05 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:06 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" returned: 0 in 0.252s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2124413315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff47b7ed-d730-4c2e-acd7-a671314bfee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:06Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Creating volume ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:06 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a5b8d2-4048-4669-9672-a5bffff5f226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:06 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 1073741824 Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fa5a0c-32bf-412c-9ac1-b27f83f98724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:06 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:06 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Volume volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f (a4a5ef03-d7e6-4a9f-833a-1b395c26c96f): created successfully Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fa5a0c-32bf-412c-9ac1-b27f83f98724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (ac5030c8-80f4-4d0f-9345-ac4b5184f605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:06 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-70c7872b-98c4-4326-844d-c683c1259eb5 tempest-VolumesActionsTest-1273148273 None] Created volume successfully. Jul 22 20:47:06 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 1073741824" returned: 0 in 0.429s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:06 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 Jul 22 20:47:06 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:06 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9" returned: 0 in 0.254s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ebd8fa-2fb8-408c-bc62-57510d22df8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2846a14-f5eb-4031-ae73-6d881693dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:06 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Volume volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 (ff47b7ed-d730-4c2e-acd7-a671314bfee9): created successfully Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2846a14-f5eb-4031-ae73-6d881693dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (c32e22d9-a942-4ba6-aff3-a4d2ef235ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:06 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8251af33-47fe-4f0e-8c13-b9c8b3a27958 tempest-VolumesSnapshotTestJSON-945850065 None] Created volume successfully. Jul 22 20:47:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-adc2017a-3645-4264-9215-57832138ed80 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" by "attach_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-adc2017a-3645-4264-9215-57832138ed80 tempest-VolumesActionsTest-1273148273 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" acquired by "attach_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-adc2017a-3645-4264-9215-57832138ed80 tempest-VolumesActionsTest-1273148273 None] Attaching volume a4a5ef03-d7e6-4a9f-833a-1b395c26c96f to instance 76e3e1bf-693a-4c12-9005-6f56fd62e8bd at mountpoint /dev/vdb on host None. Jul 22 20:47:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-adc2017a-3645-4264-9215-57832138ed80 tempest-VolumesActionsTest-1273148273 None] Attach volume completed successfully. Jul 22 20:47:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-adc2017a-3645-4264-9215-57832138ed80 tempest-VolumesActionsTest-1273148273 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" released by "attach_volume" :: held 0.091s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Creating offline snapshot 68154348-1de9-4825-a82e-fa8645c1457b of volume ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f9d50-92c6-4f32-ad67-59b786439e5c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bb8b4ed0-5851-4d1b-8e71-f7a06360a665 tempest-VolumesActionsTest-1042094795 None] Terminate volume connection completed successfully. Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bb8b4ed0-5851-4d1b-8e71-f7a06360a665 tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-detach_volume" by "detach_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bb8b4ed0-5851-4d1b-8e71-f7a06360a665 tempest-VolumesActionsTest-1042094795 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bb8b4ed0-5851-4d1b-8e71-f7a06360a665 tempest-VolumesActionsTest-1042094795 None] Detaching volume a4a5ef03-d7e6-4a9f-833a-1b395c26c96f from instance 76e3e1bf-693a-4c12-9005-6f56fd62e8bd. Jul 22 20:47:08 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 Jul 22 20:47:08 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bb8b4ed0-5851-4d1b-8e71-f7a06360a665 tempest-VolumesActionsTest-1042094795 None] Detach volume completed successfully. Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bb8b4ed0-5851-4d1b-8e71-f7a06360a665 tempest-VolumesActionsTest-1042094795 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d1b370e-e141-4bc0-a949-9346ee9345a3 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-detach_volume" by "detach_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d1b370e-e141-4bc0-a949-9346ee9345a3 tempest-VolumesActionsTest-1273148273 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3d1b370e-e141-4bc0-a949-9346ee9345a3 tempest-VolumesActionsTest-1273148273 None] Volume detach called, but volume not attached. Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3d1b370e-e141-4bc0-a949-9346ee9345a3 tempest-VolumesActionsTest-1273148273 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:08 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9" returned: 0 in 0.455s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:08 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b 1G Jul 22 20:47:08 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Acquiring lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Acquiring lock "cinder-quobyte-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Lock "cinder-quobyte-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83b7af-185f-4fd5-a583-9c6a524a5e62]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:08 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f Jul 22 20:47:08 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:09 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b 1G" returned: 0 in 0.479s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:09 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b Jul 22 20:47:09 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:09 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" returned: 0 in 0.399s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:09 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f Jul 22 20:47:09 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:09 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b" returned: 0 in 0.301s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:09 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b is being set with open permissions: ugo+rw Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:09 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b Jul 22 20:47:09 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:09 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" returned: 0 in 0.279s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Lock "cinder-quobyte-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f" released by "delete_volume" :: held 0.726s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:09 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b" returned: 0 in 0.247s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Created reservations ['8de46b4c-15d4-45a3-8a52-447a70c2e7ec', 'c8424932-eeea-4fa7-89ff-c4168c535436', 'bc9960c3-1a53-4fdd-9fd3-58a5c0bcc3f8', '59ea47c8-03eb-4934-a449-64246863aee3'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:09 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.info Jul 22 20:47:09 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:09 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:09 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:09 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.info" returned: 0 in 0.279s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:09 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.info is being set with open permissions: ugo+rw Jul 22 20:47:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:09 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.info Jul 22 20:47:09 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:10 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.299s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:10 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Deleted volume successfully. Jul 22 20:47:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d9fe720b-13b0-4b04-ad3d-b91324234cae tempest-VolumesActionsTest-1273148273 None] Lock "cinder-a4a5ef03-d7e6-4a9f-833a-1b395c26c96f-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:10 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.info" returned: 0 in 0.356s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bc3fc21c-0f77-4529-9284-15ce48aa5034 tempest-VolumesSnapshotTestJSON-945850065 None] Create snapshot completed successfully Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (47e47304-e7b1-4b53-bd9d-9fa6d2d66f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42b14dd-6076-4ec9-86dd-89e10a08174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42b14dd-6076-4ec9-86dd-89e10a08174b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-113952589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6838d6-c385-4165-9eb3-a219322908d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=68154348-1de9-4825-a82e-fa8645c1457b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:12Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f604b6e6-5e1c-4001-9efd-f8f65780f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f604b6e6-5e1c-4001-9efd-f8f65780f07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c633e7ab-31e7-4f46-ac9a-afd87c883cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c633e7ab-31e7-4f46-ac9a-afd87c883cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc6838d6-c385-4165-9eb3-a219322908d1', 'volume_name': 'volume-dc6838d6-c385-4165-9eb3-a219322908d1', 'volume_size': 2, 'snapshot_id': '68154348-1de9-4825-a82e-fa8645c1457b'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95095319-0dd2-4da0-9c0d-14c934ad1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95095319-0dd2-4da0-9c0d-14c934ad1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89404f7c-6c1c-4dba-afb3-8c20eb494fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Volume dc6838d6-c385-4165-9eb3-a219322908d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc6838d6-c385-4165-9eb3-a219322908d1', 'volume_size': 2, 'snapshot_id': '68154348-1de9-4825-a82e-fa8645c1457b'} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-68154348-1de9-4825-a82e-fa8645c1457b-dc6838d6-c385-4165-9eb3-a219322908d1" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-68154348-1de9-4825-a82e-fa8645c1457b-dc6838d6-c385-4165-9eb3-a219322908d1" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Creating volume dc6838d6-c385-4165-9eb3-a219322908d1 from snapshot 68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-dc6838d6-c385-4165-9eb3-a219322908d1" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-dc6838d6-c385-4165-9eb3-a219322908d1" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] snapshot: 68154348-1de9-4825-a82e-fa8645c1457b, volume: dc6838d6-c385-4165-9eb3-a219322908d1, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d3568c-3c99-4bf8-9d4a-d64da2eacfde]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:12 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b Jul 22 20:47:12 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:12 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a1bf4-f2a3-4cc3-aa2e-965dbdefccf4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:12 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 Jul 22 20:47:12 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:12 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9" returned: 0 in 0.393s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:47:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:12 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 Jul 22 20:47:12 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (2c17d4e2-ae0b-4812-a62a-cefbc579ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38442176-b918-4bd2-b53c-1708beb671cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38442176-b918-4bd2-b53c-1708beb671cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1219171635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f19270e-6f96-4fe2-8fc4-782207f9ac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:13Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fdb8e1-c2c7-4da7-89f9-72bd02c11bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fdb8e1-c2c7-4da7-89f9-72bd02c11bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8891a7b-38bb-4342-907c-928bc8a1934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8891a7b-38bb-4342-907c-928bc8a1934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f19270e-6f96-4fe2-8fc4-782207f9ac72', 'volume_name': 'volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6804820-a008-4e00-b827-9818a5a23491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6804820-a008-4e00-b827-9818a5a23491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e55de67-44de-437e-9837-b8989dd4feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Volume 1f19270e-6f96-4fe2-8fc4-782207f9ac72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72', 'volume_size': 1} Jul 22 20:47:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:17 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1" returned: 0 in 4.204s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63736ce-aedf-4c44-a2ee-5a96065d9487]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:17 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 Jul 22 20:47:17 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:17 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9" returned: 0 in 0.548s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9, size 1024.00 MB, duration 4.20 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:47:17 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Converted 1024.00 MB image at 243.53 MB/s Jul 22 20:47:17 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 is being set with open permissions: ugo+rw Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:17 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 Jul 22 20:47:17 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:17 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1" returned: 0 in 0.246s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-dc6838d6-c385-4165-9eb3-a219322908d1" released by "_copy_volume_from_snapshot" :: held 5.835s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-68154348-1de9-4825-a82e-fa8645c1457b-dc6838d6-c385-4165-9eb3-a219322908d1" released by "_create_volume_from_snapshot" :: held 5.862s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.876s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.564s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1219171635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f19270e-6f96-4fe2-8fc4-782207f9ac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:13Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Creating volume 1f19270e-6f96-4fe2-8fc4-782207f9ac72 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:17 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:17 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 1073741824 Jul 22 20:47:17 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89404f7c-6c1c-4dba-afb3-8c20eb494fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6838d6-c385-4165-9eb3-a219322908d1', 'volume_size': 2, 'snapshot_id': '68154348-1de9-4825-a82e-fa8645c1457b'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da53bbd0-7c55-4eb0-b0bb-0367f8ed89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:17 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Volume volume-dc6838d6-c385-4165-9eb3-a219322908d1 (dc6838d6-c385-4165-9eb3-a219322908d1): created successfully Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da53bbd0-7c55-4eb0-b0bb-0367f8ed89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (47e47304-e7b1-4b53-bd9d-9fa6d2d66f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-11284ba1-5671-4f17-8190-7ab5852dd693 tempest-VolumesSnapshotTestJSON-945850065 None] Created volume successfully. Jul 22 20:47:18 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 1073741824" returned: 0 in 0.415s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:18 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 Jul 22 20:47:18 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-dc6838d6-c385-4165-9eb3-a219322908d1-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-dc6838d6-c385-4165-9eb3-a219322908d1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:18 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-dc6838d6-c385-4165-9eb3-a219322908d1" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e55de67-44de-437e-9837-b8989dd4feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c99137-298b-40cb-8884-879d9ef79f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-dc6838d6-c385-4165-9eb3-a219322908d1" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:18 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Volume volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 (1f19270e-6f96-4fe2-8fc4-782207f9ac72): created successfully Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c99137-298b-40cb-8884-879d9ef79f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (2c17d4e2-ae0b-4812-a62a-cefbc579ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b3a37f-f46d-4c05-afac-e7cfea96a55e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2691d56b-addb-47f0-a9cf-16f78c0b9922 tempest-VolumesActionsTest-1273148273 None] Created volume successfully. Jul 22 20:47:18 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 Jul 22 20:47:18 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:19 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1" returned: 0 in 0.363s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:19 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1 Jul 22 20:47:19 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:19 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc6838d6-c385-4165-9eb3-a219322908d1" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-dc6838d6-c385-4165-9eb3-a219322908d1" released by "delete_volume" :: held 0.647s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['65a78f64-4b70-4976-8085-e50a9dd35090', '0f2d8a0e-c654-40ca-91e2-28ee86530fef', '07b36c19-549b-4f65-9f55-45303545a58a', 'dd63cf2d-0936-497b-aebe-a0d1ddf25221'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:19 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:19 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:19 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.250s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Deleted volume successfully. Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-034f7f3d-4be0-4a46-8b74-548671081a8b tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-dc6838d6-c385-4165-9eb3-a219322908d1-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-68154348-1de9-4825-a82e-fa8645c1457b-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-68154348-1de9-4825-a82e-fa8645c1457b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-ff47b7ed-d730-4c2e-acd7-a671314bfee9" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-ff47b7ed-d730-4c2e-acd7-a671314bfee9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-68154348-1de9-4825-a82e-fa8645c1457b" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-68154348-1de9-4825-a82e-fa8645c1457b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Deleting offline snapshot 68154348-1de9-4825-a82e-fa8645c1457b of volume ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] snapshot_file for this snap is: volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-1f19270e-6f96-4fe2-8fc4-782207f9ac72-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d0331-7835-487a-b49a-ab7c15f475a1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Lock "cinder-1f19270e-6f96-4fe2-8fc4-782207f9ac72-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-quobyte-1f19270e-6f96-4fe2-8fc4-782207f9ac72" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-1f19270e-6f96-4fe2-8fc4-782207f9ac72" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f84da5f-b942-4d0a-9105-2a034c950b6a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:20 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b Jul 22 20:47:20 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:20 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 Jul 22 20:47:20 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:20 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b" returned: 0 in 0.373s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd892b5d-254f-4c87-9f9e-93b135b9449d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:20 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72" returned: 0 in 0.365s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:20 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72 Jul 22 20:47:20 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:20 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 Jul 22 20:47:20 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:20 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1f19270e-6f96-4fe2-8fc4-782207f9ac72" returned: 0 in 0.254s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-1f19270e-6f96-4fe2-8fc4-782207f9ac72" released by "delete_volume" :: held 0.668s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:20 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9" returned: 0 in 0.360s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:20 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b Jul 22 20:47:20 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Created reservations ['29541639-00f9-4899-87bf-7a78521a228f', '77946ae8-5f19-4a03-9067-509675e37536', 'e714556a-f491-4c4a-98b2-e6ec0a71070c', '8a4b4384-bb3e-4d12-b2e5-be459a304ba7'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:20 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:20 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:20 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b" returned: 0 in 0.358s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:21 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:21 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b Jul 22 20:47:21 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Deleted volume successfully. Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50afefc5-c93a-4dbb-a9b1-9c80d9a4a4cd tempest-VolumesActionsTest-1042094795 None] Lock "cinder-1f19270e-6f96-4fe2-8fc4-782207f9ac72-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:21 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9.68154348-1de9-4825-a82e-fa8645c1457b" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-68154348-1de9-4825-a82e-fa8645c1457b" released by "_delete_snapshot" :: held 1.469s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-ff47b7ed-d730-4c2e-acd7-a671314bfee9" released by "delete_snapshot" :: held 1.495s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['e7e39715-0b3d-47ff-83b3-d904a4d5c091', '1ccce4d6-dd3e-494a-87e8-eaca6fde95d5', '78a586a6-ca97-4706-8546-b37f7e6b87a4', 'c28d4efe-e32b-4a42-96d6-42f86ef67ee9'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Delete snapshot completed successfully. Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c1fbdf88-3cd5-49d4-8c02-2e1eead2c505 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-68154348-1de9-4825-a82e-fa8645c1457b-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (19e77653-0b4c-4e6f-aa3b-131afe69329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2650db-37df-4226-ac62-fde7bad278fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2650db-37df-4226-ac62-fde7bad278fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-977213590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48475e2f-0c07-4da5-a993-14aac6ce5a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:22Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691d443f-5222-4e05-8377-d9eb243ddbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691d443f-5222-4e05-8377-d9eb243ddbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a4f284-efe9-453d-878e-6fd67edcee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a4f284-efe9-453d-878e-6fd67edcee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48475e2f-0c07-4da5-a993-14aac6ce5a93', 'volume_name': 'volume-48475e2f-0c07-4da5-a993-14aac6ce5a93', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b8a2cf-db73-4706-a8d5-27af3e24f609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b8a2cf-db73-4706-a8d5-27af3e24f609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf21fe4-3b7f-4fff-bc00-575888b4c778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:21 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Volume 48475e2f-0c07-4da5-a993-14aac6ce5a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48475e2f-0c07-4da5-a993-14aac6ce5a93', 'volume_size': 1} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-977213590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48475e2f-0c07-4da5-a993-14aac6ce5a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:22Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Creating volume 48475e2f-0c07-4da5-a993-14aac6ce5a93 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:21 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:21 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 1073741824 Jul 22 20:47:21 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-ff47b7ed-d730-4c2e-acd7-a671314bfee9-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-ff47b7ed-d730-4c2e-acd7-a671314bfee9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-ff47b7ed-d730-4c2e-acd7-a671314bfee9" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-ff47b7ed-d730-4c2e-acd7-a671314bfee9" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:22 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 1073741824" returned: 0 in 0.474s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[939530aa-fa30-4c80-b90f-29a7493b2e46]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:22 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 Jul 22 20:47:22 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:22 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 Jul 22 20:47:22 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:22 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf21fe4-3b7f-4fff-bc00-575888b4c778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48475e2f-0c07-4da5-a993-14aac6ce5a93', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce9314b-0512-4520-8d4a-e6874bcb9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:22 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Volume volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 (48475e2f-0c07-4da5-a993-14aac6ce5a93): created successfully Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce9314b-0512-4520-8d4a-e6874bcb9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (19e77653-0b4c-4e6f-aa3b-131afe69329c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-92f5cdbf-ab84-4463-ad7d-5f9c6340dcbc tempest-VolumesActionsTest-1273148273 None] Created volume successfully. Jul 22 20:47:22 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9" returned: 0 in 0.382s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:22 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9 Jul 22 20:47:22 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-48475e2f-0c07-4da5-a993-14aac6ce5a93-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:22 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ff47b7ed-d730-4c2e-acd7-a671314bfee9" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Lock "cinder-48475e2f-0c07-4da5-a993-14aac6ce5a93-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-ff47b7ed-d730-4c2e-acd7-a671314bfee9" released by "delete_volume" :: held 0.706s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-quobyte-48475e2f-0c07-4da5-a993-14aac6ce5a93" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-48475e2f-0c07-4da5-a993-14aac6ce5a93" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[430b3d2a-2398-42b7-ae4b-f6ade2d4606b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['d1d5ee82-1186-4534-b27e-da33981df866', '3aac6305-44ea-49f7-bd8a-a80d651a328c', 'a453c1d7-3cf7-4870-bfa6-a5aae25234fc', '8186ad18-0dc7-45d5-a3c2-2acf6df7eaac'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:22 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:22 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:23 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 Jul 22 20:47:23 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:23 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Deleted volume successfully. Jul 22 20:47:23 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc306e5-dfe9-40b8-ad7c-3b9ba0bb9255 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-ff47b7ed-d730-4c2e-acd7-a671314bfee9-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93" returned: 0 in 0.412s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:23 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93 Jul 22 20:47:23 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:23 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-48475e2f-0c07-4da5-a993-14aac6ce5a93" returned: 0 in 0.263s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-48475e2f-0c07-4da5-a993-14aac6ce5a93" released by "delete_volume" :: held 0.732s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Created reservations ['755b8923-37c4-407f-8703-659f3111578f', '4e37b29a-2543-497e-ad73-80fdba0ce346', 'cee55d31-14a9-4434-bffb-441d427d3d87', '8676f933-d5b0-489b-bcb3-6b4ef829ea49'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (142a58e3-3b92-4a53-b336-797cf267d8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466b28a9-89ca-440a-bba0-2d985a10a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466b28a9-89ca-440a-bba0-2d985a10a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-547638112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b6f13b-2a3f-4ac2-9be7-a4909c5db850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:24Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:23 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:23 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efa5a6e-27cf-4a6c-a7b1-12a34dcc11f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efa5a6e-27cf-4a6c-a7b1-12a34dcc11f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93e4f19-4c94-44da-9535-4b9e76dc4b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93e4f19-4c94-44da-9535-4b9e76dc4b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b6f13b-2a3f-4ac2-9be7-a4909c5db850', 'volume_name': 'volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991a869d-c7b9-467c-ab0f-dcfbf42f39fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991a869d-c7b9-467c-ab0f-dcfbf42f39fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9014c6a-d717-4018-8772-5f312ddec617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:23 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Volume 79b6f13b-2a3f-4ac2-9be7-a4909c5db850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850', 'volume_size': 1} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-547638112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b6f13b-2a3f-4ac2-9be7-a4909c5db850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:24Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Creating volume 79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:23 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:23 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 1073741824 Jul 22 20:47:23 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:23 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:23 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Deleted volume successfully. Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eee013c4-5695-4e8e-a460-86cb5d06a18a tempest-VolumesActionsTest-1042094795 None] Lock "cinder-48475e2f-0c07-4da5-a993-14aac6ce5a93-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:24 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 1073741824" returned: 0 in 0.444s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:24 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 Jul 22 20:47:24 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (7b714919-a82a-494d-8234-9dd8d5695d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76cd0ad-a391-4073-96ce-f158b56cc494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76cd0ad-a391-4073-96ce-f158b56cc494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196161988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5908647-702b-4628-9213-e1d2fe068ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:24Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6d0683-2ea3-4f4e-915a-0bec983b9352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6d0683-2ea3-4f4e-915a-0bec983b9352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9471fb5-e019-4575-b1bc-77bdf6c461b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9471fb5-e019-4575-b1bc-77bdf6c461b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5908647-702b-4628-9213-e1d2fe068ed3', 'volume_name': 'volume-e5908647-702b-4628-9213-e1d2fe068ed3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27572fea-b643-46fe-bd20-ff6cf6984894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27572fea-b643-46fe-bd20-ff6cf6984894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcda25c-7cbc-4e19-bfa6-97cd7c495df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:24 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Volume e5908647-702b-4628-9213-e1d2fe068ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5908647-702b-4628-9213-e1d2fe068ed3', 'volume_size': 1} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:24 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" returned: 0 in 0.263s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196161988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5908647-702b-4628-9213-e1d2fe068ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:24Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Creating volume e5908647-702b-4628-9213-e1d2fe068ed3 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:24 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9014c6a-d717-4018-8772-5f312ddec617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:24 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 1073741824 Jul 22 20:47:24 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dab092-c24b-4f44-9d10-8804313b433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:24 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Volume volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 (79b6f13b-2a3f-4ac2-9be7-a4909c5db850): created successfully Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dab092-c24b-4f44-9d10-8804313b433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (142a58e3-3b92-4a53-b336-797cf267d8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b8bd2d32-712d-44e0-aee2-014624a8e269 tempest-VolumesSnapshotTestJSON-945850065 None] Created volume successfully. Jul 22 20:47:24 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 1073741824" returned: 0 in 0.397s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:25 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 Jul 22 20:47:25 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:25 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3" returned: 0 in 0.233s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcda25c-7cbc-4e19-bfa6-97cd7c495df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5908647-702b-4628-9213-e1d2fe068ed3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b14b6a-8fb4-4ad4-a665-b0930547557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Volume volume-e5908647-702b-4628-9213-e1d2fe068ed3 (e5908647-702b-4628-9213-e1d2fe068ed3): created successfully Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b14b6a-8fb4-4ad4-a665-b0930547557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (7b714919-a82a-494d-8234-9dd8d5695d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e620c4d2-70c7-48ab-94ad-109caab28e78 tempest-VolumesActionsTest-1273148273 None] Created volume successfully. Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-e5908647-702b-4628-9213-e1d2fe068ed3-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Lock "cinder-e5908647-702b-4628-9213-e1d2fe068ed3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-quobyte-e5908647-702b-4628-9213-e1d2fe068ed3" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-e5908647-702b-4628-9213-e1d2fe068ed3" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cf481a-a272-4ac9-b99d-0e546d81d47a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:25 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 Jul 22 20:47:25 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Creating offline snapshot 3264b612-d95e-4a40-bd87-287aec90b4e7 of volume 79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d85cfce-988a-41af-9604-f4e12ca5f998]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:26 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3" returned: 0 in 0.380s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:26 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3 Jul 22 20:47:26 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:26 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 Jul 22 20:47:26 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:26 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e5908647-702b-4628-9213-e1d2fe068ed3" returned: 0 in 0.266s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-e5908647-702b-4628-9213-e1d2fe068ed3" released by "delete_volume" :: held 0.687s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:26 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:26 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 1G Jul 22 20:47:26 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Created reservations ['b5a7c530-f375-466a-94a3-74c7bde8a81a', '103306a1-cd51-4b43-bc5d-400ffd5c9f60', '5d3fe47f-2ac1-4b7d-bf6c-97ce82004c85', '90aadd31-2c37-460a-8571-b44cd3cb03a0'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:26 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:26 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:26 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.304s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Deleted volume successfully. Jul 22 20:47:26 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-391eafeb-89ab-4c12-8558-467dbf9146aa tempest-VolumesActionsTest-1042094795 None] Lock "cinder-e5908647-702b-4628-9213-e1d2fe068ed3-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 1G" returned: 0 in 0.447s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:26 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 Jul 22 20:47:26 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:27 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7" returned: 0 in 0.324s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:27 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 is being set with open permissions: ugo+rw Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:27 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 Jul 22 20:47:27 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (ae48954a-78cf-4c87-a0c1-8bb296e26002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3996797b-945c-4584-8491-47551ffbd10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3996797b-945c-4584-8491-47551ffbd10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1820234414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d0b35e-6fbd-4a28-bdc4-602953ebc996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:27Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45397c9c-951c-45c2-880b-e816a4b3f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45397c9c-951c-45c2-880b-e816a4b3f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a425fde3-32ee-4194-9b48-b6aaac5f4ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a425fde3-32ee-4194-9b48-b6aaac5f4ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d0b35e-6fbd-4a28-bdc4-602953ebc996', 'volume_name': 'volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9200419d-deeb-4e5d-9aca-6b7e7cd19fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9200419d-deeb-4e5d-9aca-6b7e7cd19fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80507401-dd45-4aff-8971-817e5b72aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:27 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Volume 86d0b35e-6fbd-4a28-bdc4-602953ebc996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996', 'volume_size': 1} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:27 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:27 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.info Jul 22 20:47:27 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:27 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.info" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:27 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.info is being set with open permissions: ugo+rw Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:27 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.info Jul 22 20:47:27 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:27 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.info" returned: 0 in 0.238s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1820234414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d0b35e-6fbd-4a28-bdc4-602953ebc996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:27Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Creating volume 86d0b35e-6fbd-4a28-bdc4-602953ebc996 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:27 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:27 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 1073741824 Jul 22 20:47:27 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-76703314-a3af-4d8f-9a3f-274bf4ae3507 tempest-VolumesSnapshotTestJSON-945850065 None] Create snapshot completed successfully Jul 22 20:47:28 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 1073741824" returned: 0 in 0.459s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:28 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 Jul 22 20:47:28 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (c12cf65f-08ae-4475-a235-069d76616199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c99d60-3851-48f2-824c-1ddbce6faa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c99d60-3851-48f2-824c-1ddbce6faa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-407170035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2658c6-af31-487b-9b18-767990327464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020fdb8e2d3446b4bed1961900d35e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3264b612-d95e-4a40-bd87-287aec90b4e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:29Z,use_quota=True,user_id='6c86faf223e146a3be948074fd92f34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103a2106-24c4-495a-a92e-24496defbe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103a2106-24c4-495a-a92e-24496defbe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:28 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683b8284-f158-4c08-b10d-d0b56530d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683b8284-f158-4c08-b10d-d0b56530d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb2658c6-af31-487b-9b18-767990327464', 'volume_name': 'volume-cb2658c6-af31-487b-9b18-767990327464', 'volume_size': 1, 'snapshot_id': '3264b612-d95e-4a40-bd87-287aec90b4e7'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8915bf-1dc2-41c7-b403-c70e3efb4a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8915bf-1dc2-41c7-b403-c70e3efb4a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e91d4e-506b-4766-82ce-7119973bb12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Volume cb2658c6-af31-487b-9b18-767990327464: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb2658c6-af31-487b-9b18-767990327464', 'volume_size': 1, 'snapshot_id': '3264b612-d95e-4a40-bd87-287aec90b4e7'} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996" returned: 0 in 0.285s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-3264b612-d95e-4a40-bd87-287aec90b4e7-cb2658c6-af31-487b-9b18-767990327464" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80507401-dd45-4aff-8971-817e5b72aad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fac3cc-50ff-4532-b3b0-5214b188b1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-3264b612-d95e-4a40-bd87-287aec90b4e7-cb2658c6-af31-487b-9b18-767990327464" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Creating volume cb2658c6-af31-487b-9b18-767990327464 from snapshot 3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-cb2658c6-af31-487b-9b18-767990327464" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Volume volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 (86d0b35e-6fbd-4a28-bdc4-602953ebc996): created successfully Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fac3cc-50ff-4532-b3b0-5214b188b1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (ae48954a-78cf-4c87-a0c1-8bb296e26002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cb2658c6-af31-487b-9b18-767990327464" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] snapshot: 3264b612-d95e-4a40-bd87-287aec90b4e7, volume: cb2658c6-af31-487b-9b18-767990327464, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:47:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0b74e8c5-add7-4636-965b-ca111b3c1a9f tempest-VolumesActionsTest-1273148273 None] Created volume successfully. Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60d40b-4172-4465-bedf-63e8fe418818]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:28 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 Jul 22 20:47:28 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:29 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7" returned: 0 in 0.348s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3241aba-652a-40df-9eac-e8769941292e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:29 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 Jul 22 20:47:29 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-86d0b35e-6fbd-4a28-bdc4-602953ebc996-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Lock "cinder-86d0b35e-6fbd-4a28-bdc4-602953ebc996-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Acquiring lock "cinder-quobyte-86d0b35e-6fbd-4a28-bdc4-602953ebc996" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-86d0b35e-6fbd-4a28-bdc4-602953ebc996" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:29 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" returned: 0 in 0.406s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba74bb2-0ef6-4ad1-af17-2d50962da73e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:29 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 Jul 22 20:47:29 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:29 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 Jul 22 20:47:29 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:29 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996" returned: 0 in 0.374s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:30 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996 Jul 22 20:47:30 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:30 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-86d0b35e-6fbd-4a28-bdc4-602953ebc996" returned: 0 in 0.521s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Lock "cinder-quobyte-86d0b35e-6fbd-4a28-bdc4-602953ebc996" released by "delete_volume" :: held 0.962s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Created reservations ['7f283023-c0e9-42b8-914b-5e97f0492c91', '04406010-fe90-42f2-be28-3fb19d87d251', '85768cf8-d418-4773-ba2a-d5e58c9dd607', 'd154e985-8b7e-4633-86a1-30b31a16eba4'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:30 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:30 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:31 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.525s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:31 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Deleted volume successfully. Jul 22 20:47:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-57fea35d-cb0d-402c-b04b-c46ce89eae17 tempest-VolumesActionsTest-1042094795 None] Lock "cinder-86d0b35e-6fbd-4a28-bdc4-602953ebc996-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (97e64b0a-bf93-4189-a79a-4a941c5ea494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ceff2c-fe09-4a1f-80a9-37ccec511dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ceff2c-fe09-4a1f-80a9-37ccec511dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-850177469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708bc05a-408d-4b21-b003-475ad7bf8d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:33Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5077ae37-2d71-4b4a-bb4b-1777fc869e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5077ae37-2d71-4b4a-bb4b-1777fc869e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154528c2-6ade-4b76-b642-5f4b857ca161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:32 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154528c2-6ade-4b76-b642-5f4b857ca161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708bc05a-408d-4b21-b003-475ad7bf8d7e', 'volume_name': 'volume-708bc05a-408d-4b21-b003-475ad7bf8d7e', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2379719-f975-44a8-ace9-f9d6a96bb582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2379719-f975-44a8-ace9-f9d6a96bb582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6d2fe9-ccd1-4cec-a14f-a534a496532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:33 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Volume 708bc05a-408d-4b21-b003-475ad7bf8d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708bc05a-408d-4b21-b003-475ad7bf8d7e', 'volume_size': 1} Jul 22 20:47:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:34 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464" returned: 0 in 4.549s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf9b056-64ec-4602-962a-8e1999f8dd65]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:34 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 Jul 22 20:47:34 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:34 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" returned: 0 in 0.525s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:47:34 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Converted 1024.00 MB image at 225.06 MB/s Jul 22 20:47:34 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 is being set with open permissions: ugo+rw Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:34 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 Jul 22 20:47:34 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:34 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464" returned: 0 in 0.250s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cb2658c6-af31-487b-9b18-767990327464" released by "_copy_volume_from_snapshot" :: held 6.170s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-3264b612-d95e-4a40-bd87-287aec90b4e7-cb2658c6-af31-487b-9b18-767990327464" released by "_create_volume_from_snapshot" :: held 6.209s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.237s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-850177469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708bc05a-408d-4b21-b003-475ad7bf8d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63283e2344ff4939b109e142c0962614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:33Z,use_quota=True,user_id='97f5386e5cb94094a3018a9eb704cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Creating volume 708bc05a-408d-4b21-b003-475ad7bf8d7e {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:34 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:35 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e 1073741824 Jul 22 20:47:35 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e91d4e-506b-4766-82ce-7119973bb12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2658c6-af31-487b-9b18-767990327464', 'volume_size': 1, 'snapshot_id': '3264b612-d95e-4a40-bd87-287aec90b4e7'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b926a181-615d-48d1-a80b-1818fd4e0156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:35 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Volume volume-cb2658c6-af31-487b-9b18-767990327464 (cb2658c6-af31-487b-9b18-767990327464): created successfully Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b926a181-615d-48d1-a80b-1818fd4e0156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Flow 'volume_create_manager' (c12cf65f-08ae-4475-a235-069d76616199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-00048b24-c4ab-4eef-9619-f48f336dd039 tempest-VolumesSnapshotTestJSON-945850065 None] Created volume successfully. Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-cb2658c6-af31-487b-9b18-767990327464-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-cb2658c6-af31-487b-9b18-767990327464-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-cb2658c6-af31-487b-9b18-767990327464" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cb2658c6-af31-487b-9b18-767990327464" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2f50ce-3c92-4964-8e0a-f43048e7d8e1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:35 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e 1073741824" returned: 0 in 0.475s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:35 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 Jul 22 20:47:35 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:35 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e Jul 22 20:47:35 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:35 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:35 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6d2fe9-ccd1-4cec-a14f-a534a496532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708bc05a-408d-4b21-b003-475ad7bf8d7e', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e708f53-67de-401e-9774-b48d4af822d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464" returned: 0 in 0.412s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:35 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Volume volume-708bc05a-408d-4b21-b003-475ad7bf8d7e (708bc05a-408d-4b21-b003-475ad7bf8d7e): created successfully Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e708f53-67de-401e-9774-b48d4af822d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:35 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464 Jul 22 20:47:35 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Flow 'volume_create_manager' (97e64b0a-bf93-4189-a79a-4a941c5ea494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1041e3f3-2718-4c28-b6e1-fd6d4e57a18f tempest-VolumesActionsTest-1273148273 None] Created volume successfully. Jul 22 20:47:36 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cb2658c6-af31-487b-9b18-767990327464" returned: 0 in 0.255s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cb2658c6-af31-487b-9b18-767990327464" released by "delete_volume" :: held 0.708s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['5d265010-d886-4e45-9317-ff108079bbed', '1f116380-057b-4e32-9c19-269bc3a81240', 'a5b91ac1-5875-42a8-af28-00c05b85c411', 'b8961941-9778-40a9-92fd-6629cfa29b2e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:36 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:36 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:36 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Deleted volume successfully. Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eb238c2e-7b45-45f4-8b7a-f98732282595 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-cb2658c6-af31-487b-9b18-767990327464-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-3264b612-d95e-4a40-bd87-287aec90b4e7-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-3264b612-d95e-4a40-bd87-287aec90b4e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-3264b612-d95e-4a40-bd87-287aec90b4e7" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-3264b612-d95e-4a40-bd87-287aec90b4e7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Deleting offline snapshot 3264b612-d95e-4a40-bd87-287aec90b4e7 of volume 79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] snapshot_file for this snap is: volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Acquiring lock "cinder-708bc05a-408d-4b21-b003-475ad7bf8d7e-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Lock "cinder-708bc05a-408d-4b21-b003-475ad7bf8d7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[39313768-f088-4490-a130-fbacfd6f3f7b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Acquiring lock "cinder-quobyte-708bc05a-408d-4b21-b003-475ad7bf8d7e" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Lock "cinder-quobyte-708bc05a-408d-4b21-b003-475ad7bf8d7e" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c444139e-b151-42e8-ba47-95ba149a0ac3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:36 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 Jul 22 20:47:36 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:36 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e Jul 22 20:47:36 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:37 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7" returned: 0 in 0.374s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a87cb7-e76a-4e6c-80db-22baac2dacf7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:37 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e" returned: 0 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:37 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e Jul 22 20:47:37 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:37 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 Jul 22 20:47:37 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:37 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-708bc05a-408d-4b21-b003-475ad7bf8d7e" returned: 0 in 0.260s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Lock "cinder-quobyte-708bc05a-408d-4b21-b003-475ad7bf8d7e" released by "delete_volume" :: held 0.662s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:37 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" returned: 0 in 0.386s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Created reservations ['ba35266b-4125-4999-b844-7ea1248ee735', '73339e5f-28ae-48cb-87a3-d0b71978d2d7', 'fca4666d-ca8e-4389-9d4f-1f8da302386e', '4984081b-ad7b-494e-b152-915fa21de778'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:37 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 Jul 22 20:47:37 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:37 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:37 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:37 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:37 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.286s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Deleted volume successfully. Jul 22 20:47:37 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7 Jul 22 20:47:37 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-04369867-629e-462b-98b1-a24a8d81618c tempest-VolumesActionsTest-1273148273 None] Lock "cinder-708bc05a-408d-4b21-b003-475ad7bf8d7e-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:38 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850.3264b612-d95e-4a40-bd87-287aec90b4e7" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-3264b612-d95e-4a40-bd87-287aec90b4e7" released by "_delete_snapshot" :: held 1.512s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" released by "delete_snapshot" :: held 1.536s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['afcc0fd2-6101-4534-b224-28cbac87959a', '6dee6bec-7551-413b-960e-55da76e9f947', 'bc7270b7-43f0-4a91-8439-a8d3f52cabc4', 'a8b307bd-9e43-48ab-99c2-5343eb2f7eea'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Delete snapshot completed successfully. Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4b7b07a5-3a73-4e5a-bbdd-d47dfbfd5ba1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-3264b612-d95e-4a40-bd87-287aec90b4e7-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-79b6f13b-2a3f-4ac2-9be7-a4909c5db850-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-79b6f13b-2a3f-4ac2-9be7-a4909c5db850-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a2b88-fe2a-4d8b-8985-232435815b2b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:39 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 Jul 22 20:47:39 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:39 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" returned: 0 in 0.384s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:39 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850 Jul 22 20:47:39 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:39 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" returned: 0 in 0.259s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-79b6f13b-2a3f-4ac2-9be7-a4909c5db850" released by "delete_volume" :: held 0.702s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['644abf4f-73ca-4f70-9256-2c5189719435', '1042dbb2-6304-4bdc-9549-49ac60bfb2aa', 'aa21cc0f-c5bd-4f2d-b285-6c4907071b03', 'd50f5031-0aa7-487d-b174-419e39b1b26f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:39 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:39 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:39 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.259s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:39 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:39 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Deleted volume successfully. Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-20619567-e731-4365-9661-0960b7b3e6f1 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-79b6f13b-2a3f-4ac2-9be7-a4909c5db850-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-cc929abb-9197-4f39-8b00-2b140e3ff570-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-cc929abb-9197-4f39-8b00-2b140e3ff570-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "cinder-quobyte-cc929abb-9197-4f39-8b00-2b140e3ff570" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cc929abb-9197-4f39-8b00-2b140e3ff570" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5aec72-3e65-4d0b-8735-36f404a261e5]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:40 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 Jul 22 20:47:40 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:40 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570" returned: 0 in 0.454s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:40 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570 Jul 22 20:47:40 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:40 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-cc929abb-9197-4f39-8b00-2b140e3ff570" returned: 0 in 0.256s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-quobyte-cc929abb-9197-4f39-8b00-2b140e3ff570" released by "delete_volume" :: held 0.777s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Created reservations ['385d4a3b-09ba-4c99-82e4-8b881badcea3', 'fd3f6809-6c9a-4de4-a846-b420437b330c', '7dab476e-44e3-4bbc-a014-79217bd7a589', '083d5156-5282-4864-9ded-cc90f748791a'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:41 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:41 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:41 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.300s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:41 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:41 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Deleted volume successfully. Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5a7339fc-6490-4612-9c22-8b4ffcea3012 tempest-VolumesSnapshotTestJSON-945850065 None] Lock "cinder-cc929abb-9197-4f39-8b00-2b140e3ff570-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:41 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:47:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:47:50 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=116,cinder:UPDATE=145,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:47:51 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=143,cinder:SELECT=121,cinder:INSERT=36,cinder:DELETE=18 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Flow 'volume_create_manager' (4513b880-f233-4128-bbb6-45f8b90c9c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ece867-7cf9-4819-b594-c612a877134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ece867-7cf9-4819-b594-c612a877134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1477503417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b41b05e-4beb-4d64-a81f-db2b9b3fc489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae06b314bbc54a44a9eedec5515839f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:52Z,use_quota=True,user_id='907c931adbc641f0b84c882920b03b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ea50f7-a5c6-47df-bdb4-0c37ce7d156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ea50f7-a5c6-47df-bdb4-0c37ce7d156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d5be8b-1785-4df3-9524-998cc37ad99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d5be8b-1785-4df3-9524-998cc37ad99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b41b05e-4beb-4d64-a81f-db2b9b3fc489', 'volume_name': 'volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e66f3d-c783-4803-85d7-f5ff91f08aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e66f3d-c783-4803-85d7-f5ff91f08aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bd4544-b3b0-4f75-897c-610864dd9060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:52 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Volume 9b41b05e-4beb-4d64-a81f-db2b9b3fc489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489', 'volume_size': 1} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1477503417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b41b05e-4beb-4d64-a81f-db2b9b3fc489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae06b314bbc54a44a9eedec5515839f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:52Z,use_quota=True,user_id='907c931adbc641f0b84c882920b03b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Creating volume 9b41b05e-4beb-4d64-a81f-db2b9b3fc489 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:52 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:52 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 1073741824 Jul 22 20:47:52 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:52 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 1073741824" returned: 0 in 0.531s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:53 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 Jul 22 20:47:53 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:53 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489" returned: 0 in 0.268s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bd4544-b3b0-4f75-897c-610864dd9060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b65674-9af5-42d5-b002-2d15e27b2e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:53 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Volume volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 (9b41b05e-4beb-4d64-a81f-db2b9b3fc489): created successfully Jul 22 20:47:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b65674-9af5-42d5-b002-2d15e27b2e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Flow 'volume_create_manager' (4513b880-f233-4128-bbb6-45f8b90c9c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-04001440-2689-44b0-b46d-3f76e6535752 tempest-VolumesTransfersTest-1592692991 None] Created volume successfully. Jul 22 20:47:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f8c40084-bfa8-47f4-a295-6d3b243e67aa tempest-VolumesTransfersTest-1231640564 None] Transfer volume completed successfully. Jul 22 20:47:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Acquiring lock "cinder-9b41b05e-4beb-4d64-a81f-db2b9b3fc489-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-9b41b05e-4beb-4d64-a81f-db2b9b3fc489-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Acquiring lock "cinder-quobyte-9b41b05e-4beb-4d64-a81f-db2b9b3fc489" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-quobyte-9b41b05e-4beb-4d64-a81f-db2b9b3fc489" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:55 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cdaef8-fd4d-4e88-b5c1-7defc89e8017]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:55 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 Jul 22 20:47:55 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:56 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489" returned: 0 in 0.388s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:56 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489 Jul 22 20:47:56 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:56 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9b41b05e-4beb-4d64-a81f-db2b9b3fc489" returned: 0 in 0.280s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-quobyte-9b41b05e-4beb-4d64-a81f-db2b9b3fc489" released by "delete_volume" :: held 0.719s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Created reservations ['22163f7a-bda7-4288-9452-62cc02effbc9', 'ae4e867e-9576-4801-99fa-3b38746502eb', 'ce42290b-5dee-403c-9105-03c5a7820e4f', 'c4658f7b-5a9d-4b05-96b0-8d7816942587'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:56 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:56 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:56 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:56 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:47:56 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Deleted volume successfully. Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5046d1bc-06e5-4d76-b69c-598afaa3a695 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-9b41b05e-4beb-4d64-a81f-db2b9b3fc489-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Flow 'volume_create_manager' (ba313b67-f607-4681-afb1-00bcafcbcd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d84299-87a9-453f-a634-78abfae82825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d84299-87a9-453f-a634-78abfae82825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1024709566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1ba326-bd6a-40e6-9f25-bfbd5622faf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae06b314bbc54a44a9eedec5515839f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:57Z,use_quota=True,user_id='907c931adbc641f0b84c882920b03b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a067bd4-c622-4234-9bc6-ee11860e0263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a067bd4-c622-4234-9bc6-ee11860e0263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0ab01-b79f-4046-a801-c12d0078ef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0ab01-b79f-4046-a801-c12d0078ef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1ba326-bd6a-40e6-9f25-bfbd5622faf4', 'volume_name': 'volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f4fe81-a303-4d0a-ace6-900c4fa5c024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f4fe81-a303-4d0a-ace6-900c4fa5c024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c9bad-b87d-4af9-8f46-b4055b792e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:57 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Volume ba1ba326-bd6a-40e6-9f25-bfbd5622faf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4', 'volume_size': 1} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1024709566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1ba326-bd6a-40e6-9f25-bfbd5622faf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae06b314bbc54a44a9eedec5515839f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:47:57Z,use_quota=True,user_id='907c931adbc641f0b84c882920b03b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Creating volume ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:47:57 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:47:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:57 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 1073741824 Jul 22 20:47:57 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:58 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 1073741824" returned: 0 in 0.464s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:58 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 Jul 22 20:47:58 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:58 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4" returned: 0 in 0.275s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c9bad-b87d-4af9-8f46-b4055b792e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfafe690-360c-4484-b08e-05836f0e16f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:47:58 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Volume volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 (ba1ba326-bd6a-40e6-9f25-bfbd5622faf4): created successfully Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfafe690-360c-4484-b08e-05836f0e16f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Flow 'volume_create_manager' (ba313b67-f607-4681-afb1-00bcafcbcd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:47:58 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c05b75d8-2b73-4767-b0a5-b7bebc5b7791 tempest-VolumesTransfersTest-1592692991 None] Created volume successfully. Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Acquiring lock "cinder-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Acquiring lock "cinder-quobyte-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-quobyte-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cffc21-387d-48e2-acf9-7414feb7a391]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:47:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:59 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 Jul 22 20:47:59 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:59 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4" returned: 0 in 0.410s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:59 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4 Jul 22 20:47:59 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:47:59 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-quobyte-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4" released by "delete_volume" :: held 0.730s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Created reservations ['b1baf809-43d7-47f3-a832-97d2ff4a4da6', '9e20f019-37bd-4daf-a812-adcad4968d54', 'e6963647-2ddc-4d61-9e04-35bb48782b62', 'b2277630-3c96-4a39-a726-644ff2ebcc1d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:47:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:47:59 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:47:59 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:00 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:00 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Deleted volume successfully. Jul 22 20:48:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5af79c6-f459-4434-b463-6b9710a849a4 tempest-VolumesTransfersTest-348078930 None] Lock "cinder-ba1ba326-bd6a-40e6-9f25-bfbd5622faf4-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Flow 'volume_create_manager' (4d45299b-bd5b-47f0-b9cd-cbd4946bb400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b540e19-a09f-4ab5-a462-a26b9fa552b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b540e19-a09f-4ab5-a462-a26b9fa552b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-625656945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fccd9b7-700c-4dd9-84e0-9b430e224529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec0cebec0534d909fd9f0a3459b79dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:06Z,use_quota=True,user_id='fc1139d6f2744940ba683e797ae3370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3e8d24-c4ce-4fb5-b924-bc0f6cf259a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3e8d24-c4ce-4fb5-b924-bc0f6cf259a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc22d25-d9b9-49fb-a3c4-c1baa38cdef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc22d25-d9b9-49fb-a3c4-c1baa38cdef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fccd9b7-700c-4dd9-84e0-9b430e224529', 'volume_name': 'volume-3fccd9b7-700c-4dd9-84e0-9b430e224529', 'volume_size': 2}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebeab2b6-4d57-4d4c-ac9b-3a453719b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebeab2b6-4d57-4d4c-ac9b-3a453719b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e746b917-df22-4117-b556-7ac4a49a6fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Volume 3fccd9b7-700c-4dd9-84e0-9b430e224529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fccd9b7-700c-4dd9-84e0-9b430e224529', 'volume_size': 2} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-625656945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fccd9b7-700c-4dd9-84e0-9b430e224529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec0cebec0534d909fd9f0a3459b79dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:06Z,use_quota=True,user_id='fc1139d6f2744940ba683e797ae3370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Creating volume 3fccd9b7-700c-4dd9-84e0-9b430e224529 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:05 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 2147483648 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:05 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 2147483648 Jul 22 20:48:05 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:06 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 2147483648" returned: 0 in 0.681s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:06 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 Jul 22 20:48:06 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:06 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529" returned: 0 in 0.260s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e746b917-df22-4117-b556-7ac4a49a6fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fccd9b7-700c-4dd9-84e0-9b430e224529', 'volume_size': 2}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6bb1c2-6aac-47e5-9937-4def07dd1031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:06 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Volume volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 (3fccd9b7-700c-4dd9-84e0-9b430e224529): created successfully Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6bb1c2-6aac-47e5-9937-4def07dd1031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Flow 'volume_create_manager' (4d45299b-bd5b-47f0-b9cd-cbd4946bb400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:06 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d83b074f-2c66-4039-aff1-57d25d0f2073 tempest-VolumesCloneNegativeTest-1224586756 None] Created volume successfully. Jul 22 20:48:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Acquiring lock "cinder-3fccd9b7-700c-4dd9-84e0-9b430e224529-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "cinder-3fccd9b7-700c-4dd9-84e0-9b430e224529-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Acquiring lock "cinder-quobyte-3fccd9b7-700c-4dd9-84e0-9b430e224529" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "cinder-quobyte-3fccd9b7-700c-4dd9-84e0-9b430e224529" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[545620b1-4720-40ba-8402-7319c58f91e1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:08 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 Jul 22 20:48:08 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:08 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529" returned: 0 in 0.367s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:08 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529 Jul 22 20:48:08 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:08 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3fccd9b7-700c-4dd9-84e0-9b430e224529" returned: 0 in 0.280s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "cinder-quobyte-3fccd9b7-700c-4dd9-84e0-9b430e224529" released by "delete_volume" :: held 0.696s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Created reservations ['4fa5414b-6b08-4277-b26d-279b43e4ee7b', '0a84bf84-9580-461a-b5a8-a7e57de7253a', '9b31461f-1584-4185-acaa-39ab06001b17', '851ffd6d-5da4-4bdf-ac0f-19c8a759e2f5'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:08 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:48:08 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:09 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:09 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Deleted volume successfully. Jul 22 20:48:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f57fc299-d572-4a2d-98d2-c7aa671661f1 tempest-VolumesCloneNegativeTest-1224586756 None] Lock "cinder-3fccd9b7-700c-4dd9-84e0-9b430e224529-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:09 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Flow 'volume_create_manager' (14439fd7-20ef-456e-bbd1-4003fa246823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7943144-8ae5-4b8e-bb60-38a4945c140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7943144-8ae5-4b8e-bb60-38a4945c140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1494876097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19af1f38-bf85-4d3c-b2b5-f93380ba7bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b86fbeabf59476eb31389253f7548a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:10Z,use_quota=True,user_id='01a0546de76a45c9bbce00d0b826da63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49d02f1-33d2-4501-900f-f5dfc471350f),volume_type_id=c49d02f1-33d2-4501-900f-f5dfc471350f)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4746776-d8fb-4431-a133-edab02e8d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4746776-d8fb-4431-a133-edab02e8d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda178bd-3a56-40d6-a664-b9e1edfa2c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda178bd-3a56-40d6-a664-b9e1edfa2c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19af1f38-bf85-4d3c-b2b5-f93380ba7bc1', 'volume_name': 'volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3f3bd8-f2f6-444e-b8ed-af314d986e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3f3bd8-f2f6-444e-b8ed-af314d986e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f07cf6e-7d64-41dc-b876-66bff9aa913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume 19af1f38-bf85-4d3c-b2b5-f93380ba7bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1', 'volume_size': 1} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1494876097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19af1f38-bf85-4d3c-b2b5-f93380ba7bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b86fbeabf59476eb31389253f7548a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:10Z,use_quota=True,user_id='01a0546de76a45c9bbce00d0b826da63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49d02f1-33d2-4501-900f-f5dfc471350f),volume_type_id=c49d02f1-33d2-4501-900f-f5dfc471350f)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Creating volume 19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:10 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:10 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 1073741824 Jul 22 20:48:10 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Flow 'volume_create_manager' (7aa17e7f-8863-43de-a0d8-85d854b81b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7745d2-63cf-4421-a56c-8750f2b0ef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7745d2-63cf-4421-a56c-8750f2b0ef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1212638933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f86fc93-1c5a-408b-b905-492893514832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b86fbeabf59476eb31389253f7548a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:10Z,use_quota=True,user_id='01a0546de76a45c9bbce00d0b826da63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad7788e2-d9b0-43b5-bd31-ca25fd42c9a6),volume_type_id=ad7788e2-d9b0-43b5-bd31-ca25fd42c9a6)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce8e243-ca55-4867-afb8-d365ac41cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce8e243-ca55-4867-afb8-d365ac41cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d695f1-198d-44ce-bdd7-39a4c2f8c5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d695f1-198d-44ce-bdd7-39a4c2f8c5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f86fc93-1c5a-408b-b905-492893514832', 'volume_name': 'volume-4f86fc93-1c5a-408b-b905-492893514832', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5ad657-17d3-4bda-8d67-f93a22f3af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5ad657-17d3-4bda-8d67-f93a22f3af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eaf4fca-32f8-45ab-a883-0761a99ed8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume 4f86fc93-1c5a-408b-b905-492893514832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f86fc93-1c5a-408b-b905-492893514832', 'volume_size': 1} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:10 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 1073741824" returned: 0 in 0.550s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:10 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 Jul 22 20:48:10 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:10 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1212638933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f86fc93-1c5a-408b-b905-492893514832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b86fbeabf59476eb31389253f7548a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:10Z,use_quota=True,user_id='01a0546de76a45c9bbce00d0b826da63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad7788e2-d9b0-43b5-bd31-ca25fd42c9a6),volume_type_id=ad7788e2-d9b0-43b5-bd31-ca25fd42c9a6)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Creating volume 4f86fc93-1c5a-408b-b905-492893514832 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:10 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f07cf6e-7d64-41dc-b876-66bff9aa913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:10 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 1073741824 Jul 22 20:48:10 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e3581d-6659-403a-94b0-024daf551ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 (19af1f38-bf85-4d3c-b2b5-f93380ba7bc1): created successfully Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e3581d-6659-403a-94b0-024daf551ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Flow 'volume_create_manager' (14439fd7-20ef-456e-bbd1-4003fa246823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7157f698-4ba9-4202-9f57-7dbce616130b tempest-TestInstancesWithCinderVolumes-1854249907 None] Created volume successfully. Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Flow 'volume_create_manager' (1eeb096a-73c3-4b60-aa0a-c1ed01ecbe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84125e01-b8ee-4e6c-8b1e-f9a5e6962a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84125e01-b8ee-4e6c-8b1e-f9a5e6962a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-228487654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dbba8e-45a8-4166-9e89-f52d78a25701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b86fbeabf59476eb31389253f7548a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:11Z,use_quota=True,user_id='01a0546de76a45c9bbce00d0b826da63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(845efc87-1338-45da-9c68-a09dec74c24e),volume_type_id=845efc87-1338-45da-9c68-a09dec74c24e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47161d5d-1a48-4786-96da-7a0dae9c6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47161d5d-1a48-4786-96da-7a0dae9c6376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c28d06-85cf-4e68-a4b9-81ac729fbfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:48:11 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 1073741824" returned: 0 in 0.522s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c28d06-85cf-4e68-a4b9-81ac729fbfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5dbba8e-45a8-4166-9e89-f52d78a25701', 'volume_name': 'volume-b5dbba8e-45a8-4166-9e89-f52d78a25701', 'volume_size': 1, 'image_id': 'f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--969815911', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b86fbeabf59476eb31389253f7548a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'created_at': datetime.datetime(2026, 7, 22, 18, 48, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 48, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa/file', 'properties': {}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba5b20e-c0a9-4b98-ab53-d3c0486a338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba5b20e-c0a9-4b98-ab53-d3c0486a338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404e4aeb-95bb-4c7d-a1ae-44b9815af749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume b5dbba8e-45a8-4166-9e89-f52d78a25701: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5dbba8e-45a8-4166-9e89-f52d78a25701', 'volume_size': 1, 'image_id': 'f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--969815911', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b86fbeabf59476eb31389253f7548a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'created_at': datetime.datetime(2026, 7, 22, 18, 48, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 48, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa/file', 'properties': {}}, 'image_service': } Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Trying to clone b5dbba8e-45a8-4166-9e89-f52d78a25701 from image f0e186ce-5c99-4c21-bf83-1df3ed45c4fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:11 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 Jul 22 20:48:11 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:11 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832" returned: 0 in 0.290s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eaf4fca-32f8-45ab-a883-0761a99ed8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f86fc93-1c5a-408b-b905-492893514832', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f01a6d-aff7-4a45-af93-f00aae3a0c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume volume-4f86fc93-1c5a-408b-b905-492893514832 (4f86fc93-1c5a-408b-b905-492893514832): created successfully Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f01a6d-aff7-4a45-af93-f00aae3a0c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Flow 'volume_create_manager' (7aa17e7f-8863-43de-a0d8-85d854b81b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5cccfab8-5eea-4191-9846-5453913e0dab tempest-TestInstancesWithCinderVolumes-1854249907 None] Created volume successfully. Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Flow 'volume_create_manager' (d30b1c0f-ae7d-4721-9501-91ef42b62526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4599696-d1b5-4e09-8f79-a75e93111ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4599696-d1b5-4e09-8f79-a75e93111ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1186689890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73b33cf-762a-42eb-8f13-ec5647d98329,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9e7a376c7d94968afd58cdcb101d31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:12Z,use_quota=True,user_id='8923785f21ab4854a10afa3439ed3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b917bc-3d32-43ad-bad1-00860d4e0d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b917bc-3d32-43ad-bad1-00860d4e0d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3df1b7b-c849-4398-95e3-a4ca2a009856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3df1b7b-c849-4398-95e3-a4ca2a009856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73b33cf-762a-42eb-8f13-ec5647d98329', 'volume_name': 'volume-e73b33cf-762a-42eb-8f13-ec5647d98329', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c128e-09d7-4d75-8077-eb70c0bcef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c128e-09d7-4d75-8077-eb70c0bcef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec76ac09-c5d0-45c3-9e7f-0e076982762f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Volume e73b33cf-762a-42eb-8f13-ec5647d98329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73b33cf-762a-42eb-8f13-ec5647d98329', 'volume_size': 1} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1186689890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73b33cf-762a-42eb-8f13-ec5647d98329,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9e7a376c7d94968afd58cdcb101d31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:12Z,use_quota=True,user_id='8923785f21ab4854a10afa3439ed3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Creating volume e73b33cf-762a-42eb-8f13-ec5647d98329 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:12 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:12 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 1073741824 Jul 22 20:48:12 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:12 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 1073741824" returned: 0 in 0.431s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:12 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 Jul 22 20:48:12 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:13 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec76ac09-c5d0-45c3-9e7f-0e076982762f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73b33cf-762a-42eb-8f13-ec5647d98329', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e817467-7a70-4200-9483-9ca2a5d6dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Volume volume-e73b33cf-762a-42eb-8f13-ec5647d98329 (e73b33cf-762a-42eb-8f13-ec5647d98329): created successfully Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e817467-7a70-4200-9483-9ca2a5d6dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Flow 'volume_create_manager' (d30b1c0f-ae7d-4721-9501-91ef42b62526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4791895a-25db-470a-8543-b3a2e1aab4bc tempest-VolumesListTestJSON-707394553 None] Created volume successfully. Jul 22 20:48:13 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Flow 'volume_create_manager' (ef9e84ab-17d4-4a1c-8e93-fc36c3abb8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995d1122-d32c-40ec-b55c-e98075144e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995d1122-d32c-40ec-b55c-e98075144e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1859974718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a645a4f0-435b-4a5e-997d-80578ce0d830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9e7a376c7d94968afd58cdcb101d31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:14Z,use_quota=True,user_id='8923785f21ab4854a10afa3439ed3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe3a903-f864-4d8a-86e8-6a0e9302ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe3a903-f864-4d8a-86e8-6a0e9302ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2b44e8-3d69-447b-8167-cd30db25852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2b44e8-3d69-447b-8167-cd30db25852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a645a4f0-435b-4a5e-997d-80578ce0d830', 'volume_name': 'volume-a645a4f0-435b-4a5e-997d-80578ce0d830', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a981d3a6-84e3-43ee-bdf8-bc4ed370d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a981d3a6-84e3-43ee-bdf8-bc4ed370d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bf08cc-60fe-490c-8b12-e002d5ed52bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Volume a645a4f0-435b-4a5e-997d-80578ce0d830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a645a4f0-435b-4a5e-997d-80578ce0d830', 'volume_size': 1} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1859974718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a645a4f0-435b-4a5e-997d-80578ce0d830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9e7a376c7d94968afd58cdcb101d31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:14Z,use_quota=True,user_id='8923785f21ab4854a10afa3439ed3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Creating volume a645a4f0-435b-4a5e-997d-80578ce0d830 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:14 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:14 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 1073741824 Jul 22 20:48:14 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:14 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 1073741824" returned: 0 in 0.460s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:14 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 Jul 22 20:48:14 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:14 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bf08cc-60fe-490c-8b12-e002d5ed52bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a645a4f0-435b-4a5e-997d-80578ce0d830', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db22119-e53d-4b81-99b0-da65741ab9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Volume volume-a645a4f0-435b-4a5e-997d-80578ce0d830 (a645a4f0-435b-4a5e-997d-80578ce0d830): created successfully Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db22119-e53d-4b81-99b0-da65741ab9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Flow 'volume_create_manager' (ef9e84ab-17d4-4a1c-8e93-fc36c3abb8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-07896a50-93b3-4460-a858-bf9fa0579200 tempest-VolumesListTestJSON-707394553 None] Created volume successfully. Jul 22 20:48:15 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD, size 20.69 MB, duration 3.73 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:48:15 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Image download 20.69 MB at 5.54 MB/s Jul 22 20:48:15 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[92355d30-efab-4ddb-8076-f44298ec3269]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:15 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD Jul 22 20:48:15 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:15 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:15 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Temporary image f0e186ce-5c99-4c21-bf83-1df3ed45c4fa is fetched for user 01a0546de76a45c9bbce00d0b826da63. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:48:15 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b414f3e-4f75-4058-ae75-5716494097b7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:15 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD Jul 22 20:48:15 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:16 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-228487654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dbba8e-45a8-4166-9e89-f52d78a25701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b86fbeabf59476eb31389253f7548a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:11Z,use_quota=True,user_id='01a0546de76a45c9bbce00d0b826da63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(845efc87-1338-45da-9c68-a09dec74c24e),volume_type_id=845efc87-1338-45da-9c68-a09dec74c24e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Creating volume b5dbba8e-45a8-4166-9e89-f52d78a25701 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:16 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:16 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 1073741824 Jul 22 20:48:16 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:16 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Flow 'volume_create_manager' (5bcb03cb-a6dc-4d82-8707-b6071f3467cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e67cf8-32f8-48d3-aef0-27ebc1fe2ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 1073741824" returned: 0 in 0.513s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e67cf8-32f8-48d3-aef0-27ebc1fe2ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1108236568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84b98bf-03e5-4140-ae15-f136dec0e352,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9e7a376c7d94968afd58cdcb101d31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:16Z,use_quota=True,user_id='8923785f21ab4854a10afa3439ed3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b58816-a047-47af-9a57-455be97923ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b58816-a047-47af-9a57-455be97923ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138aac33-c123-4ac4-9e4f-b4e5324ef458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138aac33-c123-4ac4-9e4f-b4e5324ef458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c84b98bf-03e5-4140-ae15-f136dec0e352', 'volume_name': 'volume-c84b98bf-03e5-4140-ae15-f136dec0e352', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e269a06-00df-4c1b-8fa0-686e134936fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e269a06-00df-4c1b-8fa0-686e134936fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfcabaf0-846d-4878-ac09-9b914cfa1d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:16 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Volume c84b98bf-03e5-4140-ae15-f136dec0e352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c84b98bf-03e5-4140-ae15-f136dec0e352', 'volume_size': 1} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:16 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 Jul 22 20:48:16 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:16 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1108236568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84b98bf-03e5-4140-ae15-f136dec0e352,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9e7a376c7d94968afd58cdcb101d31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:16Z,use_quota=True,user_id='8923785f21ab4854a10afa3439ed3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Creating volume c84b98bf-03e5-4140-ae15-f136dec0e352 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:16 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:16 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 1073741824 Jul 22 20:48:16 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Attempting download of f0e186ce-5c99-4c21-bf83-1df3ed45c4fa ((None, [{'url': 'file:///opt/stack/data/glance/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'metadata': {}}])) to volume b5dbba8e-45a8-4166-9e89-f52d78a25701. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[12db9fa4-64ac-4975-bb4c-3cbac32f0533]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_probp91c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:17 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_probp91c Jul 22 20:48:17 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:17 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_probp91c" returned: 0 in 0.343s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_probp91c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:17 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 1073741824" returned: 0 in 0.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:17 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 Jul 22 20:48:17 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:17 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_probp91c Jul 22 20:48:17 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:17 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352" returned: 0 in 0.260s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfcabaf0-846d-4878-ac09-9b914cfa1d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84b98bf-03e5-4140-ae15-f136dec0e352', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:17 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5596d8-e0c8-4180-bd21-a71c616be888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_probp91c" returned: 1 in 0.346s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_probp91c' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac357a-e530-4851-8b46-4aeb7fe87a88]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:17 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Volume volume-c84b98bf-03e5-4140-ae15-f136dec0e352 (c84b98bf-03e5-4140-ae15-f136dec0e352): created successfully Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5596d8-e0c8-4180-bd21-a71c616be888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Flow 'volume_create_manager' (5bcb03cb-a6dc-4d82-8707-b6071f3467cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-85a63352-8c10-4eb2-a7b5-b3e23425ac42 tempest-VolumesListTestJSON-707394553 None] Created volume successfully. Jul 22 20:48:17 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD Jul 22 20:48:17 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:18 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:18 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] f0e186ce-5c99-4c21-bf83-1df3ed45c4fa was qcow2, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:48:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:18 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 Jul 22 20:48:18 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:19 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701" returned: 0 in 1.808s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:19 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0e186ce-5c99-4c21-bf83-1df3ed45c4fa_8ullt63pdevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:48:19 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Converted 112.00 MB image at 61.89 MB/s Jul 22 20:48:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:19 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 1G Jul 22 20:48:19 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:20 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 1G" returned: 0 in 0.343s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Downloaded image f0e186ce-5c99-4c21-bf83-1df3ed45c4fa ((None, [{'url': 'file:///opt/stack/data/glance/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'metadata': {}}])) to volume b5dbba8e-45a8-4166-9e89-f52d78a25701 successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Temporary image f0e186ce-5c99-4c21-bf83-1df3ed45c4fa for user 01a0546de76a45c9bbce00d0b826da63 is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Marking volume b5dbba8e-45a8-4166-9e89-f52d78a25701 as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Copying metadata from image f0e186ce-5c99-4c21-bf83-1df3ed45c4fa to b5dbba8e-45a8-4166-9e89-f52d78a25701. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Creating volume glance metadata for volume b5dbba8e-45a8-4166-9e89-f52d78a25701 backed by image f0e186ce-5c99-4c21-bf83-1df3ed45c4fa with: {'image_id': 'f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'image_name': 'tempest-scenario-img--969815911', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404e4aeb-95bb-4c7d-a1ae-44b9815af749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5dbba8e-45a8-4166-9e89-f52d78a25701', 'volume_size': 1, 'image_id': 'f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--969815911', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6b86fbeabf59476eb31389253f7548a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f0e186ce-5c99-4c21-bf83-1df3ed45c4fa', 'created_at': datetime.datetime(2026, 7, 22, 18, 48, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 48, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0e186ce-5c99-4c21-bf83-1df3ed45c4fa/file', 'properties': {}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb1cbf0-c6c5-49db-8232-56e9532da66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:20 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Volume volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 (b5dbba8e-45a8-4166-9e89-f52d78a25701): created successfully Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb1cbf0-c6c5-49db-8232-56e9532da66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Flow 'volume_create_manager' (1eeb096a-73c3-4b60-aa0a-c1ed01ecbe07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:20 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ba43a70f-9948-41f2-b5b3-0672c92fb1cf tempest-TestInstancesWithCinderVolumes-1854249907 None] Created volume successfully. Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "cinder-c84b98bf-03e5-4140-ae15-f136dec0e352-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-c84b98bf-03e5-4140-ae15-f136dec0e352-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "cinder-quobyte-c84b98bf-03e5-4140-ae15-f136dec0e352" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-quobyte-c84b98bf-03e5-4140-ae15-f136dec0e352" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d2f258-84e8-486e-b9ab-cd44d3d79fb2]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:20 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 Jul 22 20:48:20 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:21 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352" returned: 0 in 0.373s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:21 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352 Jul 22 20:48:21 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:21 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c84b98bf-03e5-4140-ae15-f136dec0e352" returned: 0 in 0.266s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-quobyte-c84b98bf-03e5-4140-ae15-f136dec0e352" released by "delete_volume" :: held 0.680s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Created reservations ['97b5af91-fafa-46e5-8d29-11f068a40607', '2f7a3109-3b77-44f8-adaf-3e65bd566229', 'f9f241bb-5b5f-41ee-84ec-2787c11a9de5', 'e755e6bd-319b-4799-95b9-da0714f66d9e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:21 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:48:21 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:21 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.302s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Deleted volume successfully. Jul 22 20:48:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3653e30d-11a9-4dcd-9875-b48c5c663a61 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-c84b98bf-03e5-4140-ae15-f136dec0e352-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "cinder-a645a4f0-435b-4a5e-997d-80578ce0d830-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-a645a4f0-435b-4a5e-997d-80578ce0d830-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "cinder-quobyte-a645a4f0-435b-4a5e-997d-80578ce0d830" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-quobyte-a645a4f0-435b-4a5e-997d-80578ce0d830" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[11060c87-12bc-4ce9-816b-64a7ebde3447]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:22 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 Jul 22 20:48:22 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:22 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830" returned: 0 in 0.411s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:22 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830 Jul 22 20:48:22 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:22 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a645a4f0-435b-4a5e-997d-80578ce0d830" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-quobyte-a645a4f0-435b-4a5e-997d-80578ce0d830" released by "delete_volume" :: held 0.746s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Created reservations ['a50ec0b4-ef48-4ed9-b3ab-c4ecd260e132', 'd4b36cdc-c426-4c53-931e-0dfe9f9e7741', '19f86d8d-e652-4704-b224-1160fb799e30', '92629e67-e9fb-413e-9f03-2fe0f125f943'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:23 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:48:23 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:23 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "cinder-e73b33cf-762a-42eb-8f13-ec5647d98329-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Deleted volume successfully. Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-e73b33cf-762a-42eb-8f13-ec5647d98329-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dd94471e-5bd5-430d-a780-a4644cd77f40 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-a645a4f0-435b-4a5e-997d-80578ce0d830-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-a9698902-0e2e-496d-8269-5458f92b2a4a req-78414eec-3d9e-4be7-a480-ab3cc4494135 tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-a9698902-0e2e-496d-8269-5458f92b2a4a req-78414eec-3d9e-4be7-a480-ab3cc4494135 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-a9698902-0e2e-496d-8269-5458f92b2a4a req-78414eec-3d9e-4be7-a480-ab3cc4494135 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "cinder-quobyte-e73b33cf-762a-42eb-8f13-ec5647d98329" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-quobyte-e73b33cf-762a-42eb-8f13-ec5647d98329" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f317011b-5892-4d39-972e-38a631c55dbb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-a9698902-0e2e-496d-8269-5458f92b2a4a req-78414eec-3d9e-4be7-a480-ab3cc4494135 tempest-TestInstancesWithCinderVolumes-1854249907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-b5dbba8e-45a8-4166-9e89-f52d78a25701', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b728deec-5e39-4684-bf18-27dbc2a8f2e0', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:48:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-a9698902-0e2e-496d-8269-5458f92b2a4a req-78414eec-3d9e-4be7-a480-ab3cc4494135 tempest-TestInstancesWithCinderVolumes-1854249907 None] attachment_update completed successfully. Jul 22 20:48:23 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 Jul 22 20:48:23 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:24 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329" returned: 0 in 0.514s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:24 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329 Jul 22 20:48:24 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:24 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e73b33cf-762a-42eb-8f13-ec5647d98329" returned: 0 in 0.262s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-quobyte-e73b33cf-762a-42eb-8f13-ec5647d98329" released by "delete_volume" :: held 0.834s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Created reservations ['83fc4704-49ee-40ce-b6d5-5ec92a14faca', '8e1b82e4-05df-40a7-8dfc-c177c0d7f70e', 'f31e9a66-1e3f-4f0d-ba6c-1c83b484bf17', 'c447783c-610e-49d3-9571-3bafdd6b4d18'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:24 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:48:24 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:24 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.286s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Deleted volume successfully. Jul 22 20:48:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e3395a6d-464d-4c28-8a00-95144b65aea0 tempest-VolumesListTestJSON-707394553 None] Lock "cinder-e73b33cf-762a-42eb-8f13-ec5647d98329-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Flow 'volume_create_manager' (dd94050d-dd01-4d10-95dc-8eb20f18acd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48dd1dd-2597-4ecf-a0ec-a284508aba31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48dd1dd-2597-4ecf-a0ec-a284508aba31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-251684202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca48e0aa-48e4-4baf-a62e-60e69b4d1a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8944149ae0c6469e8cbcf49e803dbd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:28Z,use_quota=True,user_id='4982252a019d488cb8ba41168db951c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa0c912-a514-4bad-8cdb-e5af8d5f7f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa0c912-a514-4bad-8cdb-e5af8d5f7f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb625375-7036-443c-bb13-0950ea5afb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb625375-7036-443c-bb13-0950ea5afb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca48e0aa-48e4-4baf-a62e-60e69b4d1a26', 'volume_name': 'volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c24879-aa90-4095-b0d7-829321957cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c24879-aa90-4095-b0d7-829321957cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa80ee6e-cd12-47c8-9da6-a251e50e6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26', 'volume_size': 1} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-251684202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca48e0aa-48e4-4baf-a62e-60e69b4d1a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8944149ae0c6469e8cbcf49e803dbd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:28Z,use_quota=True,user_id='4982252a019d488cb8ba41168db951c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Creating volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:28 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:28 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 1073741824 Jul 22 20:48:28 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:28 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 1073741824" returned: 0 in 0.507s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:29 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 Jul 22 20:48:29 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:29 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" returned: 0 in 0.336s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa80ee6e-cd12-47c8-9da6-a251e50e6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef040ed-4e16-4545-9a3f-c53e577e6543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:29 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Volume volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 (ca48e0aa-48e4-4baf-a62e-60e69b4d1a26): created successfully Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef040ed-4e16-4545-9a3f-c53e577e6543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Flow 'volume_create_manager' (dd94050d-dd01-4d10-95dc-8eb20f18acd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:29 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-38a1ca04-cdfe-49c8-a09a-67ae10b92b9f tempest-VolumesSnapshotListTestJSON-1952898239 None] Created volume successfully. Jul 22 20:48:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Creating offline snapshot 835d8906-b64d-4e77-9927-b8e7775639f4 of volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:48:30 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a448d2ef-a2b4-44fa-8a58-ef0fdb7925b5]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:31 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 Jul 22 20:48:31 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:31 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" returned: 0 in 0.533s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:31 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 1G Jul 22 20:48:31 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:32 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 1G" returned: 0 in 0.618s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:32 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 Jul 22 20:48:32 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:32 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4" returned: 0 in 0.422s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:32 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 is being set with open permissions: ugo+rw Jul 22 20:48:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:32 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 Jul 22 20:48:32 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:32 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:32 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.info Jul 22 20:48:32 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:33 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.info" returned: 0 in 0.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:33 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.info is being set with open permissions: ugo+rw Jul 22 20:48:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:33 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.info Jul 22 20:48:33 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:33 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.info" returned: 0 in 0.268s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:33 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ef6ffe9b-8861-4429-88e9-3939266d406c tempest-VolumesSnapshotListTestJSON-1952898239 None] Create snapshot completed successfully Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Creating offline snapshot 6f50e934-ea5a-498c-af2c-6eca421ddab3 of volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5566d755-5fbd-4a23-8de2-96e38bf8d2a7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:34 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 Jul 22 20:48:34 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:34 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4" returned: 0 in 0.451s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:34 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 1G Jul 22 20:48:34 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:35 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 1G" returned: 0 in 0.503s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:35 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 Jul 22 20:48:35 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:35 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3" returned: 0 in 0.293s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:35 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 is being set with open permissions: ugo+rw Jul 22 20:48:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:35 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 Jul 22 20:48:35 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:35 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3" returned: 0 in 0.254s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.620s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9f421fbc-edbc-426e-a811-800e6124c0e2 tempest-VolumesSnapshotListTestJSON-1952898239 None] Create snapshot completed successfully Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Creating offline snapshot 1e0313da-2236-4b23-9f59-2c9920b55fb6 of volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7a75b1-4031-4f45-931e-bd4669509e56]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:36 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 Jul 22 20:48:36 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:36 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3" returned: 0 in 0.396s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:37 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 1G Jul 22 20:48:37 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:37 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 1G" returned: 0 in 0.508s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:37 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 Jul 22 20:48:37 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:37 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6" returned: 0 in 0.378s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:37 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 is being set with open permissions: ugo+rw Jul 22 20:48:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:37 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 Jul 22 20:48:37 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:38 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6" returned: 0 in 0.275s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.643s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d4b072c6-0e54-4353-9c32-cd7b5f507f55 tempest-VolumesSnapshotListTestJSON-1952898239 None] Create snapshot completed successfully Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-1e0313da-2236-4b23-9f59-2c9920b55fb6-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-1e0313da-2236-4b23-9f59-2c9920b55fb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-quobyte-1e0313da-2236-4b23-9f59-2c9920b55fb6" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-1e0313da-2236-4b23-9f59-2c9920b55fb6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Deleting offline snapshot 1e0313da-2236-4b23-9f59-2c9920b55fb6 of volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] snapshot_file for this snap is: volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e07f0b-401c-4eb0-9b78-a34a846a5c17]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:39 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 Jul 22 20:48:39 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:39 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6" returned: 0 in 0.376s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b26c16-ca59-4830-89f4-3a84ce51cce3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:40 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 Jul 22 20:48:40 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:40 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:40 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 Jul 22 20:48:40 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:40 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6" returned: 0 in 0.424s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:40 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6 Jul 22 20:48:40 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:41 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.1e0313da-2236-4b23-9f59-2c9920b55fb6" returned: 0 in 0.251s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-1e0313da-2236-4b23-9f59-2c9920b55fb6" released by "_delete_snapshot" :: held 1.524s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" released by "delete_snapshot" :: held 1.550s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Created reservations ['972daaa4-f504-4523-b050-e026e58c5b66', '9f3eaf41-6c31-4f91-a245-c7f114c4e9c8', '3732f6e7-2ceb-498b-a312-67ef1723b31e', 'e590072f-461a-4cc8-8c12-721568707135'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Delete snapshot completed successfully. Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7534934a-1051-4d9d-8b09-170528e074e9 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-1e0313da-2236-4b23-9f59-2c9920b55fb6-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:41 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:48:41 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:41 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.253s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-6f50e934-ea5a-498c-af2c-6eca421ddab3-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-6f50e934-ea5a-498c-af2c-6eca421ddab3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-quobyte-6f50e934-ea5a-498c-af2c-6eca421ddab3" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-6f50e934-ea5a-498c-af2c-6eca421ddab3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Deleting offline snapshot 6f50e934-ea5a-498c-af2c-6eca421ddab3 of volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] snapshot_file for this snap is: volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc6b96-8009-4b87-af28-ad5062aa7e16]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:41 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 Jul 22 20:48:41 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:42 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3" returned: 0 in 0.383s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf7b50-ca4a-4313-a648-bfda8e5aeba9]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:42 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 Jul 22 20:48:42 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:42 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4" returned: 0 in 0.386s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:42 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 Jul 22 20:48:42 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:42 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3" returned: 0 in 0.432s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:42 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3 Jul 22 20:48:42 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:43 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.6f50e934-ea5a-498c-af2c-6eca421ddab3" returned: 0 in 0.275s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-6f50e934-ea5a-498c-af2c-6eca421ddab3" released by "_delete_snapshot" :: held 1.573s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" released by "delete_snapshot" :: held 1.598s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Created reservations ['578ee68e-27ac-48db-bb2c-361bd6a36488', '34fdfadb-12c3-45f1-977e-4f338b9bf9b0', 'e9a3d7ec-743e-4fb5-ac0c-c49e0171ec1a', '737d504e-5b84-4d9d-bdd1-7b4d364c669b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:43 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Delete snapshot completed successfully. Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f44775f7-16b4-4abc-9a43-6bb3a33d14ec tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-6f50e934-ea5a-498c-af2c-6eca421ddab3-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-835d8906-b64d-4e77-9927-b8e7775639f4-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-835d8906-b64d-4e77-9927-b8e7775639f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-quobyte-835d8906-b64d-4e77-9927-b8e7775639f4" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-835d8906-b64d-4e77-9927-b8e7775639f4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Deleting offline snapshot 835d8906-b64d-4e77-9927-b8e7775639f4 of volume ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] snapshot_file for this snap is: volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[86444e03-c6a5-428d-b6cc-e26e39558449]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:44 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 Jul 22 20:48:44 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:44 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4" returned: 0 in 0.380s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd4fc6-5e02-4ea9-9e58-a1d735ccfa8a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:44 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 Jul 22 20:48:44 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:44 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" returned: 0 in 0.361s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:44 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 Jul 22 20:48:44 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:44 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4" returned: 0 in 0.326s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:45 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4 Jul 22 20:48:45 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:45 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26.835d8906-b64d-4e77-9927-b8e7775639f4" returned: 0 in 0.248s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-835d8906-b64d-4e77-9927-b8e7775639f4" released by "_delete_snapshot" :: held 1.417s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" released by "delete_snapshot" :: held 1.438s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:45 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Created reservations ['8b25ebf4-b8b1-48c2-a4ff-f136eca4a1ea', 'f2f1b051-6b58-4a46-936e-c7b883508ba8', '428244e5-99f4-474f-bbad-49bc0713e8f2', 'ea81fbe2-15c7-4f2e-a5e0-c97ee1af99e5'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Delete snapshot completed successfully. Jul 22 20:48:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1ab2a2a-6df5-47b8-a1f9-71a83f903ee1 tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-835d8906-b64d-4e77-9927-b8e7775639f4-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad504902-904d-488f-8dcd-9fd8b6f91a2a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:46 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 Jul 22 20:48:46 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:46 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" returned: 0 in 0.358s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:46 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26 Jul 22 20:48:46 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:46 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-quobyte-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26" released by "delete_volume" :: held 0.657s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Created reservations ['9a6c179f-d53f-4329-bbf5-740bd823442f', '9c7b9de8-0b4f-4253-a487-eb3b563145af', '4dc4a3a7-7e34-4bd2-99be-533e9f5a3cfc', 'd030e6d0-7e33-4d11-beee-20b79c1a724e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:46 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:48:46 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:47 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:47 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Deleted volume successfully. Jul 22 20:48:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-31af8669-e6bb-4e31-b541-0e428758db6a tempest-VolumesSnapshotListTestJSON-1952898239 None] Lock "cinder-ca48e0aa-48e4-4baf-a62e-60e69b4d1a26-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Flow 'volume_create_manager' (8aadddd2-a8cc-444f-9a2a-bab720dbb355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e02142-9cee-4469-8e19-ad10a3364c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e02142-9cee-4469-8e19-ad10a3364c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1419205157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987258e4-cfe2-47f8-9c8d-4ffbb73e6aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42706e9ed394d99a3d7fa442301c811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:50Z,use_quota=True,user_id='a68e380ca8394e67be9c55c7ba8a267b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd46f3ba-2e5d-47b5-9472-3801df4f4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd46f3ba-2e5d-47b5-9472-3801df4f4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b40729-8506-49af-94a3-3a1d3e4034de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b40729-8506-49af-94a3-3a1d3e4034de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987258e4-cfe2-47f8-9c8d-4ffbb73e6aed', 'volume_name': 'volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed', 'volume_size': 2}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28365f49-a210-4786-802f-bd447433a436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28365f49-a210-4786-802f-bd447433a436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e09cb9-6bc1-4763-a475-84cd62c8844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Volume 987258e4-cfe2-47f8-9c8d-4ffbb73e6aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed', 'volume_size': 2} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1419205157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987258e4-cfe2-47f8-9c8d-4ffbb73e6aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42706e9ed394d99a3d7fa442301c811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:48:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:48:50Z,use_quota=True,user_id='a68e380ca8394e67be9c55c7ba8a267b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Creating volume 987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:48:49 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:48:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed 2147483648 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:50 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed 2147483648 Jul 22 20:48:50 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:50 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed 2147483648" returned: 0 in 0.476s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:50 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed Jul 22 20:48:50 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:50 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" returned: 0 in 0.271s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e09cb9-6bc1-4763-a475-84cd62c8844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed', 'volume_size': 2}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4c3da1-a1de-4152-bcc1-cb0973b367d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:48:50 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Volume volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed (987258e4-cfe2-47f8-9c8d-4ffbb73e6aed): created successfully Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4c3da1-a1de-4152-bcc1-cb0973b367d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:48:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Flow 'volume_create_manager' (8aadddd2-a8cc-444f-9a2a-bab720dbb355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:48:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1c8ee0e3-a1f4-4a0f-a7cd-9382f64217d0 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Created volume successfully. Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=90,cinder:UPDATE=118,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=108,cinder:SELECT=97,cinder:INSERT=29,cinder:DELETE=11 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Creating offline snapshot f24574fb-289d-4057-89ba-c2a270117bda of volume 987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f62683-3da8-47c2-a78f-19773e680550]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:52 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed Jul 22 20:48:52 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:52 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" returned: 0 in 0.374s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda 2G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:52 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda 2G Jul 22 20:48:52 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:53 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda 2G" returned: 0 in 0.429s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:53 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda Jul 22 20:48:53 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:53 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda" returned: 0 in 0.313s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:53 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda is being set with open permissions: ugo+rw Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:53 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda Jul 22 20:48:53 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:53 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda" returned: 0 in 0.254s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:53 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.info Jul 22 20:48:53 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:53 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.info" returned: 0 in 0.249s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:53 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.info is being set with open permissions: ugo+rw Jul 22 20:48:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:53 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.info Jul 22 20:48:53 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:54 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.info" returned: 0 in 0.252s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:54 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-84d7f821-ae7e-4e88-b6e8-a43db3d186e6 tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Create snapshot completed successfully Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "cinder-f24574fb-289d-4057-89ba-c2a270117bda-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-f24574fb-289d-4057-89ba-c2a270117bda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "cinder-quobyte-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-quobyte-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "cinder-quobyte-f24574fb-289d-4057-89ba-c2a270117bda" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-quobyte-f24574fb-289d-4057-89ba-c2a270117bda" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Deleting offline snapshot f24574fb-289d-4057-89ba-c2a270117bda of volume 987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] snapshot_file for this snap is: volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed316b01-9e0b-46a4-a4be-cfc83434743f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:54 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda Jul 22 20:48:54 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:54 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda" returned: 0 in 0.397s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa36b6c7-5c8b-4f31-b713-d6d4f0faec14]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:55 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed Jul 22 20:48:55 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6b2ba26e-13a7-4fb0-8f09-029c95d4be2c req-99705b72-e46e-4404-bd90-839d6bf31a7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6b2ba26e-13a7-4fb0-8f09-029c95d4be2c req-99705b72-e46e-4404-bd90-839d6bf31a7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-6b2ba26e-13a7-4fb0-8f09-029c95d4be2c req-99705b72-e46e-4404-bd90-839d6bf31a7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-6b2ba26e-13a7-4fb0-8f09-029c95d4be2c req-99705b72-e46e-4404-bd90-839d6bf31a7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7afcd668-0232-4b4d-854c-169652b75ba4', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:48:55 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" returned: 0 in 0.392s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:55 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda Jul 22 20:48:55 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-6b2ba26e-13a7-4fb0-8f09-029c95d4be2c req-99705b72-e46e-4404-bd90-839d6bf31a7f tempest-TestInstancesWithCinderVolumes-1854249907 None] attachment_update completed successfully. Jul 22 20:48:55 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda" returned: 0 in 0.377s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:55 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda Jul 22 20:48:55 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:55 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed.f24574fb-289d-4057-89ba-c2a270117bda" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-quobyte-f24574fb-289d-4057-89ba-c2a270117bda" released by "_delete_snapshot" :: held 1.562s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-quobyte-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" released by "delete_snapshot" :: held 1.586s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Created reservations ['e45b49ca-1976-48ae-9f8c-edb626598a0f', 'd015a2b1-fb5d-49e3-9065-5595aff82bb2', '250fdd6f-645d-477e-ad4f-3c13178a8592', '0c946d54-2997-448d-8ac5-64fd0e343012'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:56 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Delete snapshot completed successfully. Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-548258c1-9983-41c9-8e19-6765a9d873dd tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-f24574fb-289d-4057-89ba-c2a270117bda-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "cinder-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "cinder-quobyte-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-quobyte-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b6480a-75e6-4184-b5aa-73994afe71d5]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:48:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:56 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed Jul 22 20:48:56 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:57 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" returned: 0 in 0.389s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:57 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed Jul 22 20:48:57 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-474d9803-2a6c-4a48-885b-9c776aacdf8a req-9058408e-bab6-4e47-8fbf-c10cc1d9af7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-474d9803-2a6c-4a48-885b-9c776aacdf8a req-9058408e-bab6-4e47-8fbf-c10cc1d9af7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-474d9803-2a6c-4a48-885b-9c776aacdf8a req-9058408e-bab6-4e47-8fbf-c10cc1d9af7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-474d9803-2a6c-4a48-885b-9c776aacdf8a req-9058408e-bab6-4e47-8fbf-c10cc1d9af7f tempest-TestInstancesWithCinderVolumes-1854249907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-4f86fc93-1c5a-408b-b905-492893514832', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29d70553-3de2-496f-8b4f-b01487ad8a27', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:48:57 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" returned: 0 in 0.260s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-quobyte-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed" released by "delete_volume" :: held 0.728s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:48:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-474d9803-2a6c-4a48-885b-9c776aacdf8a req-9058408e-bab6-4e47-8fbf-c10cc1d9af7f tempest-TestInstancesWithCinderVolumes-1854249907 None] attachment_update completed successfully. Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Created reservations ['1eb86590-cab2-4794-902c-40c069be952e', 'f3ae50e1-d171-49d9-9415-15ce891e1b35', 'e35ea076-e522-4a72-aa0e-659ec636dd41', '4f9017aa-e003-40e4-a258-c866fcbc4180'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:48:57 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:48:57 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:48:57 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.287s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:48:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Deleted volume successfully. Jul 22 20:48:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-67ec2aad-d5ba-4627-9612-6f5f68d896cb tempest-VolumesSnapshotNegativeTestJSON-1395742735 None] Lock "cinder-987258e4-cfe2-47f8-9c8d-4ffbb73e6aed-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:49:02 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-c13c0678-8b8a-41ff-a99f-05ced7394c64 req-bcc000b6-5d67-42c4-aeaa-bb346881c086 tempest-TestInstancesWithCinderVolumes-1854249907 None] Terminate volume connection completed successfully. Jul 22 20:49:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-c13c0678-8b8a-41ff-a99f-05ced7394c64 req-bcc000b6-5d67-42c4-aeaa-bb346881c086 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deleting attachment 7afcd668-0232-4b4d-854c-169652b75ba4. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "cinder-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "cinder-quobyte-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-quobyte-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6957a73c-c74c-4c5b-9098-cb9b2f3eaa1b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:03 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 Jul 22 20:49:03 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:03 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1" returned: 0 in 0.444s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:03 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1 Jul 22 20:49:03 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:03 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-quobyte-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1" released by "delete_volume" :: held 0.765s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:49:03 devstack cinder-volume[87818]: WARNING cinder.quota [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-989374483-820795952 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-989374483-820795952, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:49:03 devstack cinder-volume[87818]: WARNING cinder.quota [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-989374483-820795952 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-989374483-820795952, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Created reservations ['5691457c-f81b-40cc-b02b-02a62bb7d095', '92316b35-98ad-4c8c-9d1d-48cdc2a4a4cf', 'e16bc1d0-8d16-4158-98fe-ecda668220a1', '90e4580f-141e-4f3c-b519-9c5e7a479d7b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:04 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:49:04 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:04 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.271s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:49:04 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deleted volume successfully. Jul 22 20:49:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-efc5460f-64a1-4735-a45d-9c3b331041f2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-19af1f38-bf85-4d3c-b2b5-f93380ba7bc1-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:49:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-ba1f058c-afbe-4ab0-899a-5cea3b534af5 req-b22403e1-7333-4943-9ab5-69e1df6ae8df tempest-TestInstancesWithCinderVolumes-1854249907 None] Terminate volume connection completed successfully. Jul 22 20:49:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-ba1f058c-afbe-4ab0-899a-5cea3b534af5 req-b22403e1-7333-4943-9ab5-69e1df6ae8df tempest-TestInstancesWithCinderVolumes-1854249907 None] Deleting attachment 29d70553-3de2-496f-8b4f-b01487ad8a27. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:49:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "cinder-4f86fc93-1c5a-408b-b905-492893514832-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:49:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-4f86fc93-1c5a-408b-b905-492893514832-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:49:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "cinder-quobyte-4f86fc93-1c5a-408b-b905-492893514832" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:49:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-quobyte-4f86fc93-1c5a-408b-b905-492893514832" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:49:07 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[75162f7e-1530-4f1e-b527-240f9c1f82c4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:49:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:08 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 Jul 22 20:49:08 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:08 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832" returned: 0 in 0.433s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:08 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832 Jul 22 20:49:08 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:08 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-4f86fc93-1c5a-408b-b905-492893514832" returned: 0 in 0.291s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-quobyte-4f86fc93-1c5a-408b-b905-492893514832" released by "delete_volume" :: held 0.772s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:49:08 devstack cinder-volume[87818]: WARNING cinder.quota [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536072509-343094329 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536072509-343094329, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:49:08 devstack cinder-volume[87818]: WARNING cinder.quota [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536072509-343094329 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536072509-343094329, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Created reservations ['500a0431-912e-44bb-8eab-ce4ec5d0a922', '6af3eaea-72e3-433c-b098-d0df4e6a38ec', '5fc4d67f-f037-403d-9ecc-47461833dcdd', 'e0cf6db4-e196-434b-9baf-6f2af6d326bc'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:49:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:08 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:49:08 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:09 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.300s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:09 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:49:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Deleted volume successfully. Jul 22 20:49:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-eae667cf-8fc4-4b7a-9875-810ecf7defff tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-4f86fc93-1c5a-408b-b905-492893514832-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:49:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-060f3228-2783-4d4c-af1e-02ea263c6c68 req-34c95854-aff0-490c-b015-8a13020726e2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Terminate volume connection completed successfully. Jul 22 20:49:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-060f3228-2783-4d4c-af1e-02ea263c6c68 req-34c95854-aff0-490c-b015-8a13020726e2 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deleting attachment b728deec-5e39-4684-bf18-27dbc2a8f2e0. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:49:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "cinder-b5dbba8e-45a8-4166-9e89-f52d78a25701-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:49:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-b5dbba8e-45a8-4166-9e89-f52d78a25701-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "cinder-quobyte-b5dbba8e-45a8-4166-9e89-f52d78a25701" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-quobyte-b5dbba8e-45a8-4166-9e89-f52d78a25701" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95d74d-b9e9-4d3f-90a1-e6cebb334994]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:14 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 Jul 22 20:49:14 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:14 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701" returned: 0 in 0.384s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:14 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701 Jul 22 20:49:14 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:14 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5dbba8e-45a8-4166-9e89-f52d78a25701" returned: 0 in 0.261s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-quobyte-b5dbba8e-45a8-4166-9e89-f52d78a25701" released by "delete_volume" :: held 0.690s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:49:14 devstack cinder-volume[87818]: WARNING cinder.quota [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1280249351-268166457 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1280249351-268166457, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:49:14 devstack cinder-volume[87818]: WARNING cinder.quota [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1280249351-268166457 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1280249351-268166457, it is now deprecated. Please use the default quota class for default quota. Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Created reservations ['a58981ed-cdd5-439e-8940-e6407e5f2cf4', '3270b773-0abb-4c43-b5bf-5406bde55a22', '6c316b8e-6b91-4e39-90b9-66d2c4b96d6a', 'fd00d2e6-5c54-493d-ad96-602a9222a035'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:49:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:14 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:49:14 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:15 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.253s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:15 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:49:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Deleted volume successfully. Jul 22 20:49:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-33985aa7-e927-4b67-972b-3b4f90223516 tempest-TestInstancesWithCinderVolumes-1854249907 None] Lock "cinder-b5dbba8e-45a8-4166-9e89-f52d78a25701-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:49:24 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=47,cinder:UPDATE=44,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:49:25 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=42,cinder:UPDATE=39,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Flow 'volume_create_manager' (a974e8bb-d273-45e6-92dc-70d89a138a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9132f75b-bab2-4a4b-a718-c39e147c12fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9132f75b-bab2-4a4b-a718-c39e147c12fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-517286088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2325d50-b404-4057-80b9-50e59822761d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d2a0285a3d4375a3727b2e97af2c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:49:35Z,use_quota=True,user_id='cb904ae190af4f519373a921a4873606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e653d5-c4a9-4ea2-a587-405cc9df7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e653d5-c4a9-4ea2-a587-405cc9df7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562755ce-ba50-4fe4-9ef6-2e645f30ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562755ce-ba50-4fe4-9ef6-2e645f30ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2325d50-b404-4057-80b9-50e59822761d', 'volume_name': 'volume-e2325d50-b404-4057-80b9-50e59822761d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84577e92-a284-41d6-9b9d-efc48be39a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84577e92-a284-41d6-9b9d-efc48be39a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150235b8-a5e1-4072-ac29-987bb7b45e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:49:34 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Volume e2325d50-b404-4057-80b9-50e59822761d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2325d50-b404-4057-80b9-50e59822761d', 'volume_size': 1} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-517286088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2325d50-b404-4057-80b9-50e59822761d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d2a0285a3d4375a3727b2e97af2c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:49:35Z,use_quota=True,user_id='cb904ae190af4f519373a921a4873606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Creating volume e2325d50-b404-4057-80b9-50e59822761d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:49:34 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:49:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:34 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d 1073741824 Jul 22 20:49:34 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:35 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d 1073741824" returned: 0 in 0.651s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:35 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d Jul 22 20:49:35 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:35 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150235b8-a5e1-4072-ac29-987bb7b45e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2325d50-b404-4057-80b9-50e59822761d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184c41a9-fd43-433e-bdf0-5fe9ffc2b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:49:35 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Volume volume-e2325d50-b404-4057-80b9-50e59822761d (e2325d50-b404-4057-80b9-50e59822761d): created successfully Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184c41a9-fd43-433e-bdf0-5fe9ffc2b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:49:35 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Flow 'volume_create_manager' (a974e8bb-d273-45e6-92dc-70d89a138a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:49:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-008e2e05-4b97-4699-8cbc-bf0f02ac3ede tempest-TestMinimumBasicScenario-835668275 None] Created volume successfully. Jul 22 20:49:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-103c48f3-f394-465c-96ba-e18b27173880 req-7460ff74-cce8-4b84-9b4c-bad3cc641f68 tempest-TestMinimumBasicScenario-835668275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:49:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-103c48f3-f394-465c-96ba-e18b27173880 req-7460ff74-cce8-4b84-9b4c-bad3cc641f68 tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:49:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-103c48f3-f394-465c-96ba-e18b27173880 req-7460ff74-cce8-4b84-9b4c-bad3cc641f68 tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:49:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-103c48f3-f394-465c-96ba-e18b27173880 req-7460ff74-cce8-4b84-9b4c-bad3cc641f68 tempest-TestMinimumBasicScenario-835668275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-e2325d50-b404-4057-80b9-50e59822761d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd06f3934-d96a-44db-914e-6dd93c0db5a5', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:49:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-103c48f3-f394-465c-96ba-e18b27173880 req-7460ff74-cce8-4b84-9b4c-bad3cc641f68 tempest-TestMinimumBasicScenario-835668275 None] attachment_update completed successfully. Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:49:41 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:49:41 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:49:41 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.365s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:49:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:49:48 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:49:48 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Flow 'volume_create_manager' (832b38d9-75a0-432c-bc12-8cc8ba998fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7e2473-e78f-4468-8849-66eb8af74b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7e2473-e78f-4468-8849-66eb8af74b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-341465263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c5d54e-e6ff-4012-ac2e-f21515f5dd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a364c64d4694dea82b117b270de8178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:22Z,use_quota=True,user_id='57a401a51c1246ac8b9e144fe5ccf8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6be2dc-f708-46e5-8fb2-6f5c52276b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6be2dc-f708-46e5-8fb2-6f5c52276b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c698da2-4908-4688-a7ea-080cac21650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c698da2-4908-4688-a7ea-080cac21650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c5d54e-e6ff-4012-ac2e-f21515f5dd4c', 'volume_name': 'volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5927fb1-f4ce-4c3a-bab5-7f14cb968147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5927fb1-f4ce-4c3a-bab5-7f14cb968147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a619e2ea-bb34-4032-9d78-f29799c8770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:21 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Volume 85c5d54e-e6ff-4012-ac2e-f21515f5dd4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c', 'volume_size': 1} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-341465263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c5d54e-e6ff-4012-ac2e-f21515f5dd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a364c64d4694dea82b117b270de8178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:22Z,use_quota=True,user_id='57a401a51c1246ac8b9e144fe5ccf8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Creating volume 85c5d54e-e6ff-4012-ac2e-f21515f5dd4c {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:21 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:21 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c 1073741824 Jul 22 20:50:21 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:22 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c 1073741824" returned: 0 in 0.490s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:22 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c Jul 22 20:50:22 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:22 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c" returned: 0 in 0.282s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a619e2ea-bb34-4032-9d78-f29799c8770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4495b0a-ae7f-48db-a151-f2eca3bf3c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:22 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Volume volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c (85c5d54e-e6ff-4012-ac2e-f21515f5dd4c): created successfully Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4495b0a-ae7f-48db-a151-f2eca3bf3c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Flow 'volume_create_manager' (832b38d9-75a0-432c-bc12-8cc8ba998fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2423134f-b5ff-4495-b0a7-ae969d3d7e43 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Created volume successfully. Jul 22 20:50:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-9bf08191-7276-4ef5-b654-3d6ffda94620 req-1fc48268-79e6-463d-a0d2-52ddd9f78441 tempest-TestMinimumBasicScenario-835668275 None] Terminate volume connection completed successfully. Jul 22 20:50:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9bf08191-7276-4ef5-b654-3d6ffda94620 req-1fc48268-79e6-463d-a0d2-52ddd9f78441 tempest-TestMinimumBasicScenario-835668275 None] Deleting attachment d06f3934-d96a-44db-914e-6dd93c0db5a5. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:50:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-1d0516bb-4689-4de9-aabf-a99c815ca522 req-cece5dd1-4903-4bc8-8cbd-6eb48b94a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-1d0516bb-4689-4de9-aabf-a99c815ca522 req-cece5dd1-4903-4bc8-8cbd-6eb48b94a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-1d0516bb-4689-4de9-aabf-a99c815ca522 req-cece5dd1-4903-4bc8-8cbd-6eb48b94a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-1d0516bb-4689-4de9-aabf-a99c815ca522 req-cece5dd1-4903-4bc8-8cbd-6eb48b94a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1b95abc-7d5b-4a55-9b0f-2b1766dffacd', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:50:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-1d0516bb-4689-4de9-aabf-a99c815ca522 req-cece5dd1-4903-4bc8-8cbd-6eb48b94a2e1 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] attachment_update completed successfully. Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Acquiring lock "cinder-e2325d50-b404-4057-80b9-50e59822761d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Lock "cinder-e2325d50-b404-4057-80b9-50e59822761d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Acquiring lock "cinder-quobyte-e2325d50-b404-4057-80b9-50e59822761d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Lock "cinder-quobyte-e2325d50-b404-4057-80b9-50e59822761d" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9431c83b-2cb8-48c5-88b1-3f8680f7daed]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:25 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d Jul 22 20:50:25 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:25 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d" returned: 0 in 0.384s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:25 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d Jul 22 20:50:25 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:25 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e2325d50-b404-4057-80b9-50e59822761d" returned: 0 in 0.255s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Lock "cinder-quobyte-e2325d50-b404-4057-80b9-50e59822761d" released by "delete_volume" :: held 0.678s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Created reservations ['bd5a7336-cbf8-43d0-ad38-8d08c2647349', '5b188888-039a-4560-a292-cfc47b2911b8', '3f61ecae-a1a6-4098-80d6-4fb753c07d6c', '1296d6f0-291a-4da4-a74f-b199ace1169a'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:25 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:25 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:26 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:26 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Deleted volume successfully. Jul 22 20:50:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcc70eea-73e7-4692-be6a-ca96d76b5803 tempest-TestMinimumBasicScenario-835668275 None] Lock "cinder-e2325d50-b404-4057-80b9-50e59822761d-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-8774bb28-02fc-46b2-afb9-1451e15a86cf req-06dbca3a-94bc-44cc-bcfd-0f86749ea08b tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Terminate volume connection completed successfully. Jul 22 20:50:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-8774bb28-02fc-46b2-afb9-1451e15a86cf req-06dbca3a-94bc-44cc-bcfd-0f86749ea08b tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Deleting attachment e1b95abc-7d5b-4a55-9b0f-2b1766dffacd. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:50:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Acquiring lock "cinder-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "cinder-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Acquiring lock "cinder-quobyte-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "cinder-quobyte-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5e7aef-29de-49d5-b1da-8bac3a724390]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:50:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:29 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c Jul 22 20:50:29 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:29 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c" returned: 0 in 0.381s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:29 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c Jul 22 20:50:29 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:29 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "cinder-quobyte-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c" released by "delete_volume" :: held 0.696s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Created reservations ['647d558a-04e2-4a24-8be9-fa657b43e0b2', 'c23ce61b-b228-453b-b004-b962fc563e0c', '83eed563-f4b3-4e8d-a693-d3b682438b71', 'd6fb0667-0de9-459b-82f0-74ae7f210e78'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:29 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:29 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:30 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:30 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Deleted volume successfully. Jul 22 20:50:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4477c00c-1108-4c16-a2ef-7fd21d10d832 tempest-TestServerVolumeAttachScenarioOldVersion-655931005 None] Lock "cinder-85c5d54e-e6ff-4012-ac2e-f21515f5dd4c-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:39 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=21,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (84614a2c-bf4f-49d8-b722-9f7faf2a7a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f03d2ef-2ef9-42b4-aad1-e835546d8b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f03d2ef-2ef9-42b4-aad1-e835546d8b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-513003098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798662b8-8a57-4fb9-9ff7-09e862c3940c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:40Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce65590-087e-4433-8de6-fc69cfdd08c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce65590-087e-4433-8de6-fc69cfdd08c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0374e4fe-1178-4029-904d-0dda1d6db07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0374e4fe-1178-4029-904d-0dda1d6db07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798662b8-8a57-4fb9-9ff7-09e862c3940c', 'volume_name': 'volume-798662b8-8a57-4fb9-9ff7-09e862c3940c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cded5d4d-e544-4254-a1dc-205b4569c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cded5d4d-e544-4254-a1dc-205b4569c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19eeda6-8c45-475e-8930-a587cf0f82c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Volume 798662b8-8a57-4fb9-9ff7-09e862c3940c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798662b8-8a57-4fb9-9ff7-09e862c3940c', 'volume_size': 1} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-513003098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798662b8-8a57-4fb9-9ff7-09e862c3940c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:40Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Creating volume 798662b8-8a57-4fb9-9ff7-09e862c3940c {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:40 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:40 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c 1073741824 Jul 22 20:50:40 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (d19b15a3-a5fe-4b54-80e7-db9238af54bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703f6a1d-6458-45e6-b81c-0a02bab2528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703f6a1d-6458-45e6-b81c-0a02bab2528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-864644867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520ae458-bd66-4f28-a9f4-90b5f6f8bd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:41Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f8f2f8-450e-4702-8137-6402d0120bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f8f2f8-450e-4702-8137-6402d0120bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6cec71-c2f5-4cc6-bc1d-6ec6c5b697af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6cec71-c2f5-4cc6-bc1d-6ec6c5b697af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520ae458-bd66-4f28-a9f4-90b5f6f8bd69', 'volume_name': 'volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec94e01-1f2a-475e-b823-39136b5be5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec94e01-1f2a-475e-b823-39136b5be5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bafb05a4-6810-4b63-8944-9aa2bb77e582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Volume 520ae458-bd66-4f28-a9f4-90b5f6f8bd69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69', 'volume_size': 1} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:41 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c 1073741824" returned: 0 in 0.705s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:41 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:41 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:41 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c Jul 22 20:50:41 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (c34ce175-547a-460a-bfbe-8b54494523fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351a9317-b59f-4fde-bc46-2c390956fb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351a9317-b59f-4fde-bc46-2c390956fb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059248197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aea9a2-48ef-43c2-826e-2e204f5ba21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:41Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6d9ea5-fd37-448f-8a1b-bf997dc2ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6d9ea5-fd37-448f-8a1b-bf997dc2ef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec9c1ed-1730-466f-af6e-3426efcaeea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec9c1ed-1730-466f-af6e-3426efcaeea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7aea9a2-48ef-43c2-826e-2e204f5ba21e', 'volume_name': 'volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e423fe-269f-4097-9025-e97feda372da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e423fe-269f-4097-9025-e97feda372da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd545e4-f3f5-4d18-99b6-4059d26baf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Volume c7aea9a2-48ef-43c2-826e-2e204f5ba21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e', 'volume_size': 1} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:41 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.328s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:50:41 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c" returned: 0 in 0.416s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-864644867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520ae458-bd66-4f28-a9f4-90b5f6f8bd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:41Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Creating volume 520ae458-bd66-4f28-a9f4-90b5f6f8bd69 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:41 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19eeda6-8c45-475e-8930-a587cf0f82c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798662b8-8a57-4fb9-9ff7-09e862c3940c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 1073741824 Jul 22 20:50:41 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84ba45a-799c-4f50-a542-fa9819fd16db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Volume volume-798662b8-8a57-4fb9-9ff7-09e862c3940c (798662b8-8a57-4fb9-9ff7-09e862c3940c): created successfully Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84ba45a-799c-4f50-a542-fa9819fd16db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (84614a2c-bf4f-49d8-b722-9f7faf2a7a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (68252f11-e518-4a88-b231-acd407723707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ca4900-7250-44b6-bcf8-6c5c7c21374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1cbc692f-ed00-4897-b394-bb2cf6950727 tempest-CreateVolumesFromImageTest-1108517228 None] Created volume successfully. Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ca4900-7250-44b6-bcf8-6c5c7c21374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1939474652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc737f0-285b-4d1a-9d8d-6b645a4d297d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:42Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0af7257-fba0-4dde-beaf-1b4c471ea300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0af7257-fba0-4dde-beaf-1b4c471ea300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f780213-2386-4449-bc2e-99b83e0a38a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f780213-2386-4449-bc2e-99b83e0a38a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc737f0-285b-4d1a-9d8d-6b645a4d297d', 'volume_name': 'volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d7521a-56e3-4862-8332-fae97a13f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d7521a-56e3-4862-8332-fae97a13f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf3f13e-c1e0-4a97-b4b4-fd23dd9090b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:41 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Volume 0dc737f0-285b-4d1a-9d8d-6b645a4d297d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d', 'volume_size': 1} Jul 22 20:50:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (a0066081-6581-407c-82f1-ac958c54deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ce7967-4ab3-4b10-b218-84b9899406e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ce7967-4ab3-4b10-b218-84b9899406e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172960292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9d3546-f352-425b-ad03-f84819956ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:42Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7bf5dd-ea33-4006-845d-47fb409a5682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7bf5dd-ea33-4006-845d-47fb409a5682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5199f71-8bea-42ba-89c4-14d2d3695aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5199f71-8bea-42ba-89c4-14d2d3695aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9d3546-f352-425b-ad03-f84819956ffc', 'volume_name': 'volume-fb9d3546-f352-425b-ad03-f84819956ffc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:42 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd30884-c3ea-4f81-a67a-1e173faf9c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd30884-c3ea-4f81-a67a-1e173faf9c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edc7e33-610b-4ef7-9947-ef47813ca81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Volume fb9d3546-f352-425b-ad03-f84819956ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9d3546-f352-425b-ad03-f84819956ffc', 'volume_size': 1} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 1073741824" returned: 0 in 0.636s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:42 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 Jul 22 20:50:42 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:42 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059248197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aea9a2-48ef-43c2-826e-2e204f5ba21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:41Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Creating volume c7aea9a2-48ef-43c2-826e-2e204f5ba21e {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:42 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:42 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e 1073741824 Jul 22 20:50:42 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bafb05a4-6810-4b63-8944-9aa2bb77e582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f405504d-ab41-4545-8b53-ce219e9946da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:42 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Volume volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 (520ae458-bd66-4f28-a9f4-90b5f6f8bd69): created successfully Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f405504d-ab41-4545-8b53-ce219e9946da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (d19b15a3-a5fe-4b54-80e7-db9238af54bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:42 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e99eade4-d23e-4a03-a515-c7c173338b50 tempest-CreateVolumesFromImageTest-1108517228 None] Created volume successfully. Jul 22 20:50:43 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e 1073741824" returned: 0 in 0.451s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:43 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e Jul 22 20:50:43 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:43 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e" returned: 0 in 0.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1939474652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc737f0-285b-4d1a-9d8d-6b645a4d297d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:42Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Creating volume 0dc737f0-285b-4d1a-9d8d-6b645a4d297d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:43 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:43 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d 1073741824 Jul 22 20:50:43 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd545e4-f3f5-4d18-99b6-4059d26baf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035e6aad-07bf-4291-a012-adfbd4814390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:43 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Volume volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e (c7aea9a2-48ef-43c2-826e-2e204f5ba21e): created successfully Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035e6aad-07bf-4291-a012-adfbd4814390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (c34ce175-547a-460a-bfbe-8b54494523fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:43 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4f45719d-061d-4b62-bac5-f7d74626be4a tempest-CreateVolumesFromImageTest-1108517228 None] Created volume successfully. Jul 22 20:50:43 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d 1073741824" returned: 0 in 0.484s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:44 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d Jul 22 20:50:44 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:44 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d" returned: 0 in 0.249s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172960292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9d3546-f352-425b-ad03-f84819956ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5290c5d27b964d9e986df44cbe28741f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:42Z,use_quota=True,user_id='66eb63392f3c48f59a3447bb3e2f2c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Creating volume fb9d3546-f352-425b-ad03-f84819956ffc {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:44 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf3f13e-c1e0-4a97-b4b4-fd23dd9090b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:44 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc 1073741824 Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7562bac8-4f7f-4c5a-a3f4-9ae9fb2f4818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:44 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:44 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Volume volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d (0dc737f0-285b-4d1a-9d8d-6b645a4d297d): created successfully Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7562bac8-4f7f-4c5a-a3f4-9ae9fb2f4818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (68252f11-e518-4a88-b231-acd407723707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-59e4dfa5-c2b8-443a-827d-60be3cc5785e tempest-CreateVolumesFromImageTest-1108517228 None] Created volume successfully. Jul 22 20:50:44 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc 1073741824" returned: 0 in 0.481s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:44 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc Jul 22 20:50:44 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:45 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edc7e33-610b-4ef7-9947-ef47813ca81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9d3546-f352-425b-ad03-f84819956ffc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b957b8c2-34af-4e3d-b11e-d77c908d4e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:45 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Volume volume-fb9d3546-f352-425b-ad03-f84819956ffc (fb9d3546-f352-425b-ad03-f84819956ffc): created successfully Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b957b8c2-34af-4e3d-b11e-d77c908d4e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Flow 'volume_create_manager' (a0066081-6581-407c-82f1-ac958c54deee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8d0e80a9-fb72-47aa-bda3-701576d969ee tempest-CreateVolumesFromImageTest-1108517228 None] Created volume successfully. Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-fb9d3546-f352-425b-ad03-f84819956ffc-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-fb9d3546-f352-425b-ad03-f84819956ffc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-quobyte-fb9d3546-f352-425b-ad03-f84819956ffc" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-fb9d3546-f352-425b-ad03-f84819956ffc" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b48daf-ef86-4a25-90e3-34bd4beecb8d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:50:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:46 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc Jul 22 20:50:46 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:46 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc" returned: 0 in 0.400s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:46 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc Jul 22 20:50:46 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:46 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fb9d3546-f352-425b-ad03-f84819956ffc" returned: 0 in 0.272s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-fb9d3546-f352-425b-ad03-f84819956ffc" released by "delete_volume" :: held 0.719s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Created reservations ['068468a5-9172-4a4b-a181-eff25e400eab', '5a65b4a3-2075-42a9-bb25-649ea7a32d07', 'c8e058c4-71d0-4043-9584-ee29c95a14f0', '261b17ae-3127-47ea-8be5-b81126e9a5f6'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:46 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:46 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:46 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-0dc737f0-285b-4d1a-9d8d-6b645a4d297d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.278s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Deleted volume successfully. Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-0dc737f0-285b-4d1a-9d8d-6b645a4d297d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-dc79148a-68fb-4edd-9199-5fb3ac4a56d8 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-fb9d3546-f352-425b-ad03-f84819956ffc-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-quobyte-0dc737f0-285b-4d1a-9d8d-6b645a4d297d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-0dc737f0-285b-4d1a-9d8d-6b645a4d297d" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[192207f7-2d40-4adb-b745-6bcc2d35a3a0]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:47 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d Jul 22 20:50:47 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:47 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d" returned: 0 in 0.429s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:47 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d Jul 22 20:50:47 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:47 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0dc737f0-285b-4d1a-9d8d-6b645a4d297d" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-0dc737f0-285b-4d1a-9d8d-6b645a4d297d" released by "delete_volume" :: held 0.741s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Created reservations ['452ba7ae-7676-4ce6-953e-3993a94acdba', '98fb7b3b-bfb1-48ab-ba07-a4f6d93ae06a', '77ccf303-9aee-47db-89d2-9f2cf9886a05', '8033fb55-2511-4990-8195-bd7917433bbf'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:47 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:47 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-c7aea9a2-48ef-43c2-826e-2e204f5ba21e-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-c7aea9a2-48ef-43c2-826e-2e204f5ba21e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:48 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-quobyte-c7aea9a2-48ef-43c2-826e-2e204f5ba21e" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:48 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Deleted volume successfully. Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-c7aea9a2-48ef-43c2-826e-2e204f5ba21e" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-573a6795-38d4-49ab-8728-c9bc9599bc2c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-0dc737f0-285b-4d1a-9d8d-6b645a4d297d-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45765e01-febf-4c3f-9e6e-67ab2a439846]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:48 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e Jul 22 20:50:48 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:48 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e" returned: 0 in 0.375s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:48 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e Jul 22 20:50:48 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:48 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c7aea9a2-48ef-43c2-826e-2e204f5ba21e" returned: 0 in 0.256s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-c7aea9a2-48ef-43c2-826e-2e204f5ba21e" released by "delete_volume" :: held 0.697s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Created reservations ['c073f27b-f21c-4a43-a6cc-68a1aa96290a', 'd8790b9f-3010-44dd-83b4-6f27385a1dac', '7cd4d404-ab1e-49f5-8104-5d84a46861ae', 'f5a5f1e0-2274-432a-85f1-0223da7b9675'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:49 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:49 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-520ae458-bd66-4f28-a9f4-90b5f6f8bd69-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:49 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.261s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-520ae458-bd66-4f28-a9f4-90b5f6f8bd69-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Deleted volume successfully. Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b660d1ec-3450-4789-88ca-169790aa4f30 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-c7aea9a2-48ef-43c2-826e-2e204f5ba21e-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-quobyte-520ae458-bd66-4f28-a9f4-90b5f6f8bd69" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-520ae458-bd66-4f28-a9f4-90b5f6f8bd69" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e662ab-7804-43be-ad0a-dacf6dcf2ded]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:49 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 Jul 22 20:50:49 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:49 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69" returned: 0 in 0.493s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:50 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69 Jul 22 20:50:50 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:50 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-520ae458-bd66-4f28-a9f4-90b5f6f8bd69" returned: 0 in 0.255s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-520ae458-bd66-4f28-a9f4-90b5f6f8bd69" released by "delete_volume" :: held 0.804s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Created reservations ['5356691d-acf1-4ad7-bec3-c45d7ca6971e', '09763bf9-bb75-4f87-aef5-94c757f3e13e', '25564bae-fff6-452e-b188-9c42863cb2c5', '3c0f37d3-5c07-4d80-b9ff-1f062499f5ba'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:50 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:50 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-798662b8-8a57-4fb9-9ff7-09e862c3940c-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-798662b8-8a57-4fb9-9ff7-09e862c3940c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "cinder-quobyte-798662b8-8a57-4fb9-9ff7-09e862c3940c" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-798662b8-8a57-4fb9-9ff7-09e862c3940c" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e499dd00-1132-45ee-bf66-03a9593623df]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:50 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Deleted volume successfully. Jul 22 20:50:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d5d02be9-4d0b-4d79-ab28-4faa8fc3fc27 tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-520ae458-bd66-4f28-a9f4-90b5f6f8bd69-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:50 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c Jul 22 20:50:50 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:51 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c" returned: 0 in 0.398s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:51 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c Jul 22 20:50:51 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:51 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-798662b8-8a57-4fb9-9ff7-09e862c3940c" returned: 0 in 0.251s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-quobyte-798662b8-8a57-4fb9-9ff7-09e862c3940c" released by "delete_volume" :: held 0.696s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Created reservations ['e58e68c6-ad53-4e58-9de5-c8d9201b3e92', '9f8fde16-11f1-484c-b7ff-3de2953889a8', '2517a792-89da-4209-a0b8-356602b72f2f', '1dfd4baf-0c7d-4dce-8a35-a4bc34f4e42e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:51 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:50:51 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:51 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.279s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:50:51 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Deleted volume successfully. Jul 22 20:50:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-da738cec-1eed-4e0b-ad65-b7dccb9c189c tempest-CreateVolumesFromImageTest-1108517228 None] Lock "cinder-798662b8-8a57-4fb9-9ff7-09e862c3940c-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:50:54 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (74d69cfc-fc97-4dd3-b6de-084338d72d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b436d39c-90c9-4a2e-866a-3f19309be852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b436d39c-90c9-4a2e-866a-3f19309be852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062393076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0283d6e8-5281-498f-900a-abed86959e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:55Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b60bfd-985e-4c6d-a2ae-9aeb83cf75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b60bfd-985e-4c6d-a2ae-9aeb83cf75b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd0c176-ca28-4eb5-9c6d-bbb2bb53ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd0c176-ca28-4eb5-9c6d-bbb2bb53ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0283d6e8-5281-498f-900a-abed86959e8c', 'volume_name': 'volume-0283d6e8-5281-498f-900a-abed86959e8c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d2c4cb-ba0c-4929-8942-6dbc9c9d8e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d2c4cb-ba0c-4929-8942-6dbc9c9d8e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98d259e-12ef-4dd1-af20-60b2a742de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:55 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume 0283d6e8-5281-498f-900a-abed86959e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0283d6e8-5281-498f-900a-abed86959e8c', 'volume_size': 1} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062393076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0283d6e8-5281-498f-900a-abed86959e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:55Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Creating volume 0283d6e8-5281-498f-900a-abed86959e8c {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:55 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:55 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c 1073741824 Jul 22 20:50:55 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:55 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c 1073741824" returned: 0 in 0.451s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:55 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c Jul 22 20:50:55 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:55 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98d259e-12ef-4dd1-af20-60b2a742de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0283d6e8-5281-498f-900a-abed86959e8c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8df33a6-8823-45bd-b138-54f3f5a729a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:55 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume volume-0283d6e8-5281-498f-900a-abed86959e8c (0283d6e8-5281-498f-900a-abed86959e8c): created successfully Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8df33a6-8823-45bd-b138-54f3f5a729a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (74d69cfc-fc97-4dd3-b6de-084338d72d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ec3bb96d-36c8-4c3e-acb0-11cf632b7cb8 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created volume successfully. Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (0b916fa0-a477-4705-8115-0689c79e727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2588066-2ed9-4339-adcf-c3a5625448ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2588066-2ed9-4339-adcf-c3a5625448ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279259144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cef867-3d17-4f29-9c91-70d2dc7b2ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:56Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9b3821-7066-4736-96d3-03d8a4c88557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9b3821-7066-4736-96d3-03d8a4c88557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae7391b-dbde-402f-968e-c0f8123eec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae7391b-dbde-402f-968e-c0f8123eec97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82cef867-3d17-4f29-9c91-70d2dc7b2ec8', 'volume_name': 'volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01954fc6-dbea-429c-821f-a2d47acca737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01954fc6-dbea-429c-821f-a2d47acca737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cf09b9-401b-443b-b220-189e7b805d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:56 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume 82cef867-3d17-4f29-9c91-70d2dc7b2ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8', 'volume_size': 1} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279259144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cef867-3d17-4f29-9c91-70d2dc7b2ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:56Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Creating volume 82cef867-3d17-4f29-9c91-70d2dc7b2ec8 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:56 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:56 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 1073741824 Jul 22 20:50:56 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:56 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (24cee202-7ed3-4095-aaa3-dbfe364cd74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8281220-7e5c-468b-b3c5-2c9c5983dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8281220-7e5c-468b-b3c5-2c9c5983dac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375831862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070df5af-60be-46fd-8cdf-45b2f7d064ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:57Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923821c1-2d81-4d58-aeac-92216ea03e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923821c1-2d81-4d58-aeac-92216ea03e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d46d054-3913-45b1-b3bf-84077368307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d46d054-3913-45b1-b3bf-84077368307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070df5af-60be-46fd-8cdf-45b2f7d064ef', 'volume_name': 'volume-070df5af-60be-46fd-8cdf-45b2f7d064ef', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00986c1d-e402-43a7-854c-63236b92b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00986c1d-e402-43a7-854c-63236b92b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb8f993-ce80-4801-a52a-6ea72b178e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume 070df5af-60be-46fd-8cdf-45b2f7d064ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070df5af-60be-46fd-8cdf-45b2f7d064ef', 'volume_size': 1} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:57 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 1073741824" returned: 0 in 0.584s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:57 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 Jul 22 20:50:57 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (b6bc964f-7350-47e8-925d-52b229402a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b04461-4be6-4bbf-ad06-283b4d4b4ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b04461-4be6-4bbf-ad06-283b4d4b4ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556340049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d275307-0ca6-4923-a557-704b200eb0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:57Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c86529-417b-4372-adf3-c3d836ee0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c86529-417b-4372-adf3-c3d836ee0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b1f8a-a03f-42a2-bf5e-b2ffa548c968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b1f8a-a03f-42a2-bf5e-b2ffa548c968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d275307-0ca6-4923-a557-704b200eb0c7', 'volume_name': 'volume-7d275307-0ca6-4923-a557-704b200eb0c7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8795e135-6b26-4a54-a3db-51919c23327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8795e135-6b26-4a54-a3db-51919c23327c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312d558d-082c-4f02-9bd6-c8d2ea118598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume 7d275307-0ca6-4923-a557-704b200eb0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d275307-0ca6-4923-a557-704b200eb0c7', 'volume_size': 1} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:57 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8" returned: 0 in 0.302s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375831862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070df5af-60be-46fd-8cdf-45b2f7d064ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:57Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Creating volume 070df5af-60be-46fd-8cdf-45b2f7d064ef {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:57 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:57 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef 1073741824 Jul 22 20:50:57 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cf09b9-401b-443b-b220-189e7b805d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4645f937-eb49-4d97-99f8-238f63760bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 (82cef867-3d17-4f29-9c91-70d2dc7b2ec8): created successfully Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4645f937-eb49-4d97-99f8-238f63760bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (0b916fa0-a477-4705-8115-0689c79e727b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-fd262078-ea02-43f6-8d4d-b9b3e198b21f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created volume successfully. Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (0ebf5d16-2525-4d14-8cec-4ad834cfbe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eebbe7d-8376-476a-865a-d056de221b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eebbe7d-8376-476a-865a-d056de221b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2086411082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afe5293-fac0-4024-a2a3-78685cdc6a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:58Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ae316e-8159-4d4d-911c-d3bd90130a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ae316e-8159-4d4d-911c-d3bd90130a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10264f35-9d7b-44d1-ac7f-76027b285f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10264f35-9d7b-44d1-ac7f-76027b285f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afe5293-fac0-4024-a2a3-78685cdc6a66', 'volume_name': 'volume-2afe5293-fac0-4024-a2a3-78685cdc6a66', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777e1f34-ba95-4749-81eb-99857ba692e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777e1f34-ba95-4749-81eb-99857ba692e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2786fb1-e1fb-4153-9868-19aec08f5d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:57 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume 2afe5293-fac0-4024-a2a3-78685cdc6a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afe5293-fac0-4024-a2a3-78685cdc6a66', 'volume_size': 1} Jul 22 20:50:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:58 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (a630f5ec-0190-478d-84a4-deb2f543bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99924346-aa41-458e-bcb3-0b11d1ea09c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef 1073741824" returned: 0 in 0.739s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99924346-aa41-458e-bcb3-0b11d1ea09c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107749758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2dcb0d-93a9-4575-9b8b-39977e5aac68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:58Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4170fe-3db4-4e56-8bfd-854baa84c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4170fe-3db4-4e56-8bfd-854baa84c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209a1581-f593-4c50-bf11-e6a5c0cd91c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209a1581-f593-4c50-bf11-e6a5c0cd91c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2dcb0d-93a9-4575-9b8b-39977e5aac68', 'volume_name': 'volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72aa4223-50f0-4cb2-9c39-e18c6d2388f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72aa4223-50f0-4cb2-9c39-e18c6d2388f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb79d5f-2328-49af-87ae-4edee31d6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:58 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume 0d2dcb0d-93a9-4575-9b8b-39977e5aac68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68', 'volume_size': 1} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:58 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef Jul 22 20:50:58 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:58 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556340049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d275307-0ca6-4923-a557-704b200eb0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:57Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Creating volume 7d275307-0ca6-4923-a557-704b200eb0c7 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:58 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:58 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 1073741824 Jul 22 20:50:58 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb8f993-ce80-4801-a52a-6ea72b178e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070df5af-60be-46fd-8cdf-45b2f7d064ef', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81d9096-ac5e-41ac-85a6-8577d9d139a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:58 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume volume-070df5af-60be-46fd-8cdf-45b2f7d064ef (070df5af-60be-46fd-8cdf-45b2f7d064ef): created successfully Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81d9096-ac5e-41ac-85a6-8577d9d139a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (24cee202-7ed3-4095-aaa3-dbfe364cd74a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:58 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-33b6666b-5b10-4b22-9909-39bd3795c893 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created volume successfully. Jul 22 20:50:59 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 1073741824" returned: 0 in 0.473s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:59 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 Jul 22 20:50:59 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:59 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7" returned: 0 in 0.262s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2086411082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afe5293-fac0-4024-a2a3-78685cdc6a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:58Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Creating volume 2afe5293-fac0-4024-a2a3-78685cdc6a66 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:50:59 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312d558d-082c-4f02-9bd6-c8d2ea118598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d275307-0ca6-4923-a557-704b200eb0c7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebb5478-a475-4373-b9dc-6ad2b998cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:50:59 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 1073741824 Jul 22 20:50:59 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:50:59 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume volume-7d275307-0ca6-4923-a557-704b200eb0c7 (7d275307-0ca6-4923-a557-704b200eb0c7): created successfully Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebb5478-a475-4373-b9dc-6ad2b998cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (b6bc964f-7350-47e8-925d-52b229402a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:50:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7dce4b56-0eef-41ec-88b3-b94860e1378f tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created volume successfully. Jul 22 20:50:59 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 1073741824" returned: 0 in 0.499s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:50:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:50:59 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 Jul 22 20:50:59 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:00 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66" returned: 0 in 0.325s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.976s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107749758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2dcb0d-93a9-4575-9b8b-39977e5aac68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975bf3b0b8a84aeb9a9c4edb8812d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:50:58Z,use_quota=True,user_id='4856e6a3850e424abce373cb8e99b377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Creating volume 0d2dcb0d-93a9-4575-9b8b-39977e5aac68 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:51:00 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2786fb1-e1fb-4153-9868-19aec08f5d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afe5293-fac0-4024-a2a3-78685cdc6a66', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7528f406-2b47-4328-9b6c-e65e62f44301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:00 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 1073741824 Jul 22 20:51:00 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:00 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 (2afe5293-fac0-4024-a2a3-78685cdc6a66): created successfully Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7528f406-2b47-4328-9b6c-e65e62f44301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (0ebf5d16-2525-4d14-8cec-4ad834cfbe18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:51:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-37e00428-bf3a-4b41-a4d4-2556c5131079 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created volume successfully. Jul 22 20:51:00 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 1073741824" returned: 0 in 0.507s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:00 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 Jul 22 20:51:00 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:01 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb79d5f-2328-49af-87ae-4edee31d6650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1115fef-67b8-40a6-9b4f-02dcacfafca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:01 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Volume volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 (0d2dcb0d-93a9-4575-9b8b-39977e5aac68): created successfully Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1115fef-67b8-40a6-9b4f-02dcacfafca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Flow 'volume_create_manager' (a630f5ec-0190-478d-84a4-deb2f543bde4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:51:01 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-96d98665-93c5-458f-82a1-29552602c7f1 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created volume successfully. Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-0d2dcb0d-93a9-4575-9b8b-39977e5aac68-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-0d2dcb0d-93a9-4575-9b8b-39977e5aac68-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-quobyte-0d2dcb0d-93a9-4575-9b8b-39977e5aac68" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-0d2dcb0d-93a9-4575-9b8b-39977e5aac68" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c09d5-33af-4f70-a7fd-409c64909245]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:01 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 Jul 22 20:51:01 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:02 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68" returned: 0 in 0.400s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:02 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68 Jul 22 20:51:02 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:02 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0d2dcb0d-93a9-4575-9b8b-39977e5aac68" returned: 0 in 0.266s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-0d2dcb0d-93a9-4575-9b8b-39977e5aac68" released by "delete_volume" :: held 0.714s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created reservations ['3a550ce9-8071-4109-b5cb-0eec6713f01a', 'c8fb0d32-eb7b-4ba0-a234-f5c8f541ad17', '4ea151a8-a803-4f29-97ea-20d9d3952188', '90a5e2e7-f379-4ab1-a8c7-bfbb04d55e06'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:02 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:51:02 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:02 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.252s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:51:02 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Deleted volume successfully. Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-2afe5293-fac0-4024-a2a3-78685cdc6a66-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-2afe5293-fac0-4024-a2a3-78685cdc6a66-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-993ee35d-6d90-4d00-957e-cf3bd5b57991 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-0d2dcb0d-93a9-4575-9b8b-39977e5aac68-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-quobyte-2afe5293-fac0-4024-a2a3-78685cdc6a66" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-2afe5293-fac0-4024-a2a3-78685cdc6a66" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[10504bfb-6a35-4d3d-a421-e971a386f10e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:03 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 Jul 22 20:51:03 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:03 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66" returned: 0 in 0.392s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:03 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66 Jul 22 20:51:03 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:03 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2afe5293-fac0-4024-a2a3-78685cdc6a66" returned: 0 in 0.248s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-2afe5293-fac0-4024-a2a3-78685cdc6a66" released by "delete_volume" :: held 0.684s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created reservations ['d4976e8d-5bfa-442f-9783-f0b0055971a6', 'a0d85646-79e7-44da-a5f0-7dacd9bfdd92', '7adac1f9-dfbd-43ae-b2df-f7fb36c2047d', '6da5b0bc-8ce3-43a4-bf05-0b60dda45a16'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:03 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:51:03 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:04 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-7d275307-0ca6-4923-a557-704b200eb0c7-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.294s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:51:04 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Deleted volume successfully. Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-7d275307-0ca6-4923-a557-704b200eb0c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a755805b-5383-468a-ba8c-d35b9f4b6fbf tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-2afe5293-fac0-4024-a2a3-78685cdc6a66-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-quobyte-7d275307-0ca6-4923-a557-704b200eb0c7" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-7d275307-0ca6-4923-a557-704b200eb0c7" acquired by "delete_volume" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[260974ea-0723-4475-954f-3719efe0883b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:04 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 Jul 22 20:51:04 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:04 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7" returned: 0 in 0.424s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:04 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7 Jul 22 20:51:04 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:04 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7d275307-0ca6-4923-a557-704b200eb0c7" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-7d275307-0ca6-4923-a557-704b200eb0c7" released by "delete_volume" :: held 0.824s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created reservations ['aaa3328f-54d0-452b-a506-45e81c1bed2b', '33abc7db-11cc-4247-a5ac-f87a07fa3c66', '1d689d3e-bca2-4e0b-96a8-fe656d27cfe0', '8051ac0a-0c73-4505-8511-b0df617528cd'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:05 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:51:05 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-070df5af-60be-46fd-8cdf-45b2f7d064ef-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-070df5af-60be-46fd-8cdf-45b2f7d064ef-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-quobyte-070df5af-60be-46fd-8cdf-45b2f7d064ef" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-070df5af-60be-46fd-8cdf-45b2f7d064ef" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ccd61d-db68-4780-ad70-0a2594092e57]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:05 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.364s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:51:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Deleted volume successfully. Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f98f56df-6ae5-4ac3-a5b4-42d96bea5e35 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-7d275307-0ca6-4923-a557-704b200eb0c7-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:05 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef Jul 22 20:51:05 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:05 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef" returned: 0 in 0.411s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:05 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef Jul 22 20:51:05 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:06 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-070df5af-60be-46fd-8cdf-45b2f7d064ef" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-070df5af-60be-46fd-8cdf-45b2f7d064ef" released by "delete_volume" :: held 0.722s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created reservations ['188ea36c-1d47-4d7c-91b8-4e1c65c1985b', '2695945a-1a47-4ff0-b85e-4d6037b60d0a', 'afef2eb1-3b11-4ef1-b3a1-322a62c48146', 'e6af55cd-811f-4cf2-8412-246246e39e3b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:06 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:51:06 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-82cef867-3d17-4f29-9c91-70d2dc7b2ec8-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-82cef867-3d17-4f29-9c91-70d2dc7b2ec8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:06 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.280s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:51:06 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Deleted volume successfully. Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-quobyte-82cef867-3d17-4f29-9c91-70d2dc7b2ec8" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-77559d8a-0ed9-4dbb-9340-80c9aa1ab35d tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-070df5af-60be-46fd-8cdf-45b2f7d064ef-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-82cef867-3d17-4f29-9c91-70d2dc7b2ec8" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e409d244-0894-404a-ae36-70dba262ba71]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:06 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 Jul 22 20:51:06 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:06 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8" returned: 0 in 0.391s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:07 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8 Jul 22 20:51:07 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:07 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-82cef867-3d17-4f29-9c91-70d2dc7b2ec8" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-82cef867-3d17-4f29-9c91-70d2dc7b2ec8" released by "delete_volume" :: held 0.700s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created reservations ['bf1c7ba6-4510-49d0-897c-af589f25555a', '83d76241-a4dd-4614-bddb-10f948cd2cc5', '45772d79-95b4-4b4b-a202-c261c78b014f', '62f9203f-0868-4105-bb66-63798045e29d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:07 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:51:07 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-0283d6e8-5281-498f-900a-abed86959e8c-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:07 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.296s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-0283d6e8-5281-498f-900a-abed86959e8c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Deleted volume successfully. Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e7b71f04-7cb8-4de4-a768-4dbee39b6487 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-82cef867-3d17-4f29-9c91-70d2dc7b2ec8-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "cinder-quobyte-0283d6e8-5281-498f-900a-abed86959e8c" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-0283d6e8-5281-498f-900a-abed86959e8c" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebec880-6135-48c3-a425-b7dff83be93f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:07 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c Jul 22 20:51:07 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:08 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c" returned: 0 in 0.389s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:08 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c Jul 22 20:51:08 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Flow 'volume_create_manager' (4dc8b2f9-25a7-4aca-8c01-2fbf5abe2fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f142afb-70e6-4f4b-ae21-b8b2e6b06f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f142afb-70e6-4f4b-ae21-b8b2e6b06f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1027620772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6230d214-072f-4097-bf2b-98e86c83855a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e1ee3575674754a4fc5c65616657be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:51:08Z,use_quota=True,user_id='045d29e12e614794b3502624038cbf61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87785347-e2e0-4b90-9f07-9001b24f1b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87785347-e2e0-4b90-9f07-9001b24f1b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b3bae3-6adc-448b-aa16-18e036f8da07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b3bae3-6adc-448b-aa16-18e036f8da07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6230d214-072f-4097-bf2b-98e86c83855a', 'volume_name': 'volume-6230d214-072f-4097-bf2b-98e86c83855a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60baa580-29eb-440a-843e-f0a0b2f5f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60baa580-29eb-440a-843e-f0a0b2f5f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c47e73c-840b-46fb-a6c3-562d45249ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Volume 6230d214-072f-4097-bf2b-98e86c83855a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6230d214-072f-4097-bf2b-98e86c83855a', 'volume_size': 1} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1027620772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6230d214-072f-4097-bf2b-98e86c83855a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e1ee3575674754a4fc5c65616657be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:51:08Z,use_quota=True,user_id='045d29e12e614794b3502624038cbf61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Creating volume 6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:51:08 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:08 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-0283d6e8-5281-498f-900a-abed86959e8c" returned: 0 in 0.294s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:08 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a 1073741824 Jul 22 20:51:08 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-quobyte-0283d6e8-5281-498f-900a-abed86959e8c" released by "delete_volume" :: held 0.734s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Created reservations ['b416587c-ebac-45e5-aea9-559697af1dee', '6bf3a55f-622a-4aff-b42d-1d050c6c6a17', '0ffdd5dc-40f5-4576-abb9-57c5a69bbb84', '8eeb0f7d-b592-46ab-b1c0-4c1c12c60208'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:08 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:51:08 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:08 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.305s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:51:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Deleted volume successfully. Jul 22 20:51:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e2f0eb4c-7129-433b-a39a-0fca3f11e5a0 tempest-CreateVolumesFromSourceVolumeTest-410744256 None] Lock "cinder-0283d6e8-5281-498f-900a-abed86959e8c-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:09 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a 1073741824" returned: 0 in 0.547s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:09 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a Jul 22 20:51:09 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:09 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a" returned: 0 in 0.287s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c47e73c-840b-46fb-a6c3-562d45249ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6230d214-072f-4097-bf2b-98e86c83855a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8243f91c-2c32-413f-9a04-de8275bb2fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:09 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Volume volume-6230d214-072f-4097-bf2b-98e86c83855a (6230d214-072f-4097-bf2b-98e86c83855a): created successfully Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8243f91c-2c32-413f-9a04-de8275bb2fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Flow 'volume_create_manager' (4dc8b2f9-25a7-4aca-8c01-2fbf5abe2fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:51:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bee6b2a3-f28f-4479-9093-9472fedf0657 tempest-TestStampPattern-1081874420 None] Created volume successfully. Jul 22 20:51:19 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=79,cinder:UPDATE=121,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:51:19 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=79,cinder:UPDATE=127,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:51:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-f5617b2f-467d-40fd-b016-593daefcb8d9 req-de8b7fd4-e3f1-40d3-b23e-507e5b32bad1 tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-f5617b2f-467d-40fd-b016-593daefcb8d9 req-de8b7fd4-e3f1-40d3-b23e-507e5b32bad1 tempest-TestStampPattern-1081874420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-f5617b2f-467d-40fd-b016-593daefcb8d9 req-de8b7fd4-e3f1-40d3-b23e-507e5b32bad1 tempest-TestStampPattern-1081874420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:38 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-f5617b2f-467d-40fd-b016-593daefcb8d9 req-de8b7fd4-e3f1-40d3-b23e-507e5b32bad1 tempest-TestStampPattern-1081874420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-6230d214-072f-4097-bf2b-98e86c83855a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95171385-7b40-47e3-988e-af293b728e4d', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:51:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-f5617b2f-467d-40fd-b016-593daefcb8d9 req-de8b7fd4-e3f1-40d3-b23e-507e5b32bad1 tempest-TestStampPattern-1081874420 None] attachment_update completed successfully. Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:41 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:51:41 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:41 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.249s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:51:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:51:42 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-5287bc4f-d723-4ed0-8925-ef20b4869ac5 req-8cffbd65-f108-450a-beca-5c484f251c3b tempest-TestStampPattern-1081874420 None] Terminate volume connection completed successfully. Jul 22 20:51:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-5287bc4f-d723-4ed0-8925-ef20b4869ac5 req-8cffbd65-f108-450a-beca-5c484f251c3b tempest-TestStampPattern-1081874420 None] Deleting attachment 95171385-7b40-47e3-988e-af293b728e4d. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:51:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Creating offline snapshot 0fe0bffb-e8b8-4380-839f-e9aba08bafa1 of volume 6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:51:43 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[04456354-2270-44a0-b190-57134aeb540c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:43 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a Jul 22 20:51:43 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:43 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a" returned: 0 in 0.364s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:43 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 1G Jul 22 20:51:43 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:44 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 1G" returned: 0 in 0.387s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6230d214-072f-4097-bf2b-98e86c83855a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:44 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6230d214-072f-4097-bf2b-98e86c83855a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 Jul 22 20:51:44 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:44 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6230d214-072f-4097-bf2b-98e86c83855a -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1" returned: 0 in 0.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:44 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 is being set with open permissions: ugo+rw Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:44 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 Jul 22 20:51:44 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:44 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1" returned: 0 in 0.243s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:44 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.info Jul 22 20:51:44 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:44 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.info" returned: 0 in 0.248s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:44 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.info is being set with open permissions: ugo+rw Jul 22 20:51:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:44 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.info Jul 22 20:51:44 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:45 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.info" returned: 0 in 0.242s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7b14d9c0-6502-4d14-b7c8-42ef381cf9b9 tempest-TestStampPattern-1081874420 None] Create snapshot completed successfully Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Flow 'volume_create_manager' (8adbb6ce-44cf-4b69-9238-3cc94bc95fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd57c5f-459d-479f-9dc1-e7fb60d57169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd57c5f-459d-479f-9dc1-e7fb60d57169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-759211295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f85581-7e08-46b8-b135-f88445816798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e1ee3575674754a4fc5c65616657be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0fe0bffb-e8b8-4380-839f-e9aba08bafa1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:51:52Z,use_quota=True,user_id='045d29e12e614794b3502624038cbf61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45137a-161b-4eed-b307-62a4f30321f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45137a-161b-4eed-b307-62a4f30321f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc18e1d1-2b4f-4177-acc7-27ce01c0320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc18e1d1-2b4f-4177-acc7-27ce01c0320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5f85581-7e08-46b8-b135-f88445816798', 'volume_name': 'volume-b5f85581-7e08-46b8-b135-f88445816798', 'volume_size': 1, 'snapshot_id': '0fe0bffb-e8b8-4380-839f-e9aba08bafa1'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c1bf32-59c6-4c00-975f-38e20aa9b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c1bf32-59c6-4c00-975f-38e20aa9b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd72216-0a28-4fcc-b691-7c339f1b2f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:52 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Volume b5f85581-7e08-46b8-b135-f88445816798: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5f85581-7e08-46b8-b135-f88445816798', 'volume_size': 1, 'snapshot_id': '0fe0bffb-e8b8-4380-839f-e9aba08bafa1'} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-quobyte-0fe0bffb-e8b8-4380-839f-e9aba08bafa1-b5f85581-7e08-46b8-b135-f88445816798" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-0fe0bffb-e8b8-4380-839f-e9aba08bafa1-b5f85581-7e08-46b8-b135-f88445816798" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Creating volume b5f85581-7e08-46b8-b135-f88445816798 from snapshot 0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-quobyte-b5f85581-7e08-46b8-b135-f88445816798" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-b5f85581-7e08-46b8-b135-f88445816798" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] snapshot: 0fe0bffb-e8b8-4380-839f-e9aba08bafa1, volume: b5f85581-7e08-46b8-b135-f88445816798, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c825c744-7e22-467a-a131-c76aa5b9a9cd]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:52 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 Jul 22 20:51:52 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:52 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1" returned: 0 in 0.382s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6230d214-072f-4097-bf2b-98e86c83855a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cbc928-1317-48b0-b084-3eddcd839a51]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:52 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a Jul 22 20:51:52 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:53 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a" returned: 0 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:53 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:51:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:53 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 Jul 22 20:51:53 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:58 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798" returned: 0 in 5.571s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:58 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e61f65-5c6a-4b31-8818-4fee772773aa]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:51:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:58 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a Jul 22 20:51:58 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:59 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a" returned: 0 in 0.626s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:51:59 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Converted 1024.00 MB image at 183.73 MB/s Jul 22 20:51:59 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 is being set with open permissions: ugo+rw Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:51:59 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 Jul 22 20:51:59 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:51:59 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-b5f85581-7e08-46b8-b135-f88445816798" released by "_copy_volume_from_snapshot" :: held 7.369s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-0fe0bffb-e8b8-4380-839f-e9aba08bafa1-b5f85581-7e08-46b8-b135-f88445816798" released by "_create_volume_from_snapshot" :: held 7.401s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.418s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd72216-0a28-4fcc-b691-7c339f1b2f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f85581-7e08-46b8-b135-f88445816798', 'volume_size': 1, 'snapshot_id': '0fe0bffb-e8b8-4380-839f-e9aba08bafa1'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d903d0d-6e18-4ca3-a748-7165898313d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:51:59 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Volume volume-b5f85581-7e08-46b8-b135-f88445816798 (b5f85581-7e08-46b8-b135-f88445816798): created successfully Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d903d0d-6e18-4ca3-a748-7165898313d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:51:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Flow 'volume_create_manager' (8adbb6ce-44cf-4b69-9238-3cc94bc95fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:51:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a0090784-ba91-4c1a-a0c0-511b1c054eba tempest-TestStampPattern-1081874420 None] Created volume successfully. Jul 22 20:52:09 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=15,cinder:DELETE=1,cinder:UPDATE=2 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:52:09 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:52:36 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:41 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:52:41 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:41 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.265s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9863ca3d-dcf0-4db1-91d3-dc447b7035ff req-8e5e362c-f55e-44fd-916c-96f871f9eb0e tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9863ca3d-dcf0-4db1-91d3-dc447b7035ff req-8e5e362c-f55e-44fd-916c-96f871f9eb0e tempest-TestStampPattern-1081874420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[096db241-70f3-4359-aca3-0ad045b6db50]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:52:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-9863ca3d-dcf0-4db1-91d3-dc447b7035ff req-8e5e362c-f55e-44fd-916c-96f871f9eb0e tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:42 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 Jul 22 20:52:42 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:42 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [req-9863ca3d-dcf0-4db1-91d3-dc447b7035ff req-8e5e362c-f55e-44fd-916c-96f871f9eb0e tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [req-9863ca3d-dcf0-4db1-91d3-dc447b7035ff req-8e5e362c-f55e-44fd-916c-96f871f9eb0e tempest-TestStampPattern-1081874420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.378s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:52:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-9863ca3d-dcf0-4db1-91d3-dc447b7035ff req-8e5e362c-f55e-44fd-916c-96f871f9eb0e tempest-TestStampPattern-1081874420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789', 'name': 'volume-b5f85581-7e08-46b8-b135-f88445816798', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '301c70dd-d0b0-489f-8939-808a462faaee', 'enforce_multipath': True} {{(pid=87818) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 20:52:42 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-9863ca3d-dcf0-4db1-91d3-dc447b7035ff req-8e5e362c-f55e-44fd-916c-96f871f9eb0e tempest-TestStampPattern-1081874420 None] attachment_update completed successfully. Jul 22 20:52:45 devstack cinder-volume[87818]: INFO cinder.volume.manager [req-520aa3f0-02a8-40fb-b14c-8225e37c00ba req-c33eb8a4-c32e-4812-b7fe-5cb8bbff2550 tempest-TestStampPattern-1081874420 None] Terminate volume connection completed successfully. Jul 22 20:52:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [req-520aa3f0-02a8-40fb-b14c-8225e37c00ba req-c33eb8a4-c32e-4812-b7fe-5cb8bbff2550 tempest-TestStampPattern-1081874420 None] Deleting attachment 301c70dd-d0b0-489f-8939-808a462faaee. {{(pid=87818) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 20:52:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-b5f85581-7e08-46b8-b135-f88445816798-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:52:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Lock "cinder-b5f85581-7e08-46b8-b135-f88445816798-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:52:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-quobyte-b5f85581-7e08-46b8-b135-f88445816798" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:52:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-b5f85581-7e08-46b8-b135-f88445816798" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:52:49 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d8eab7-e230-426b-9edf-6f2dadb3ee6a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:52:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:49 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 Jul 22 20:52:49 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:50 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798" returned: 0 in 0.356s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:50 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798 Jul 22 20:52:50 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:50 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b5f85581-7e08-46b8-b135-f88445816798" returned: 0 in 0.254s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-b5f85581-7e08-46b8-b135-f88445816798" released by "delete_volume" :: held 0.648s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Created reservations ['df979a00-4dc6-4bb6-ac08-aab8d25b4d37', '48e8224f-dc1b-45bd-a149-2d68afb18086', '5907c014-cfe3-464e-a39b-a779b7be064b', '6f13457a-e9bf-44e8-acf0-391f67035a1a'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:50 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:52:50 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:50 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.246s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:52:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Deleted volume successfully. Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5f6d9d94-666b-48fc-9863-016a817aa677 tempest-TestStampPattern-1081874420 None] Lock "cinder-b5f85581-7e08-46b8-b135-f88445816798-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:52:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-0fe0bffb-e8b8-4380-839f-e9aba08bafa1-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Lock "cinder-0fe0bffb-e8b8-4380-839f-e9aba08bafa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-quobyte-6230d214-072f-4097-bf2b-98e86c83855a" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-6230d214-072f-4097-bf2b-98e86c83855a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-quobyte-0fe0bffb-e8b8-4380-839f-e9aba08bafa1" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-0fe0bffb-e8b8-4380-839f-e9aba08bafa1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Deleting offline snapshot 0fe0bffb-e8b8-4380-839f-e9aba08bafa1 of volume 6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] snapshot_file for this snap is: volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[63142c92-53a5-497f-8b5d-1657851ad651]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:51 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 Jul 22 20:52:51 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:51 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1" returned: 0 in 0.363s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6230d214-072f-4097-bf2b-98e86c83855a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efa8b81-cd7b-4ea0-8e55-8f11edf78d5a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:51 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a Jul 22 20:52:51 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:51 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a" returned: 0 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:51 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 Jul 22 20:52:51 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:52 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1" returned: 0 in 0.340s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:52 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1 Jul 22 20:52:52 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:52 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a.0fe0bffb-e8b8-4380-839f-e9aba08bafa1" returned: 0 in 0.250s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-0fe0bffb-e8b8-4380-839f-e9aba08bafa1" released by "_delete_snapshot" :: held 1.400s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:52:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-6230d214-072f-4097-bf2b-98e86c83855a" released by "delete_snapshot" :: held 1.419s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:52:52 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Created reservations ['e60d669a-066d-4b9b-b9cd-0e50e1ed6bba', '0ad999d0-5a9a-4bb3-b846-8a2e93f3e369', '28d01e67-381c-4f97-b29f-6f3bbd401b98', 'e9f768ac-bf47-4ea2-bd32-5ebd0c4f632e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:52:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Delete snapshot completed successfully. Jul 22 20:52:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6bbc59cd-1c18-4df4-b96c-8e825ddfd007 tempest-TestStampPattern-1081874420 None] Lock "cinder-0fe0bffb-e8b8-4380-839f-e9aba08bafa1-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-6230d214-072f-4097-bf2b-98e86c83855a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Lock "cinder-6230d214-072f-4097-bf2b-98e86c83855a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Acquiring lock "cinder-quobyte-6230d214-072f-4097-bf2b-98e86c83855a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-6230d214-072f-4097-bf2b-98e86c83855a" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c71e07-c9a9-4d40-b1af-0afaaad0a30f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:56 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a Jul 22 20:52:56 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:56 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:57 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a Jul 22 20:52:57 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:57 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6230d214-072f-4097-bf2b-98e86c83855a" returned: 0 in 0.242s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Lock "cinder-quobyte-6230d214-072f-4097-bf2b-98e86c83855a" released by "delete_volume" :: held 0.648s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Created reservations ['c12c242f-073a-4d7a-a78c-ade4009d30d9', '788bd403-acc8-4f21-ad3b-5644ce133ed7', '29256627-9bb6-467e-962e-933f559f460a', 'a0981b3d-aed8-4a51-a338-c7892671598e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:52:57 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:52:57 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:52:57 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:52:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Deleted volume successfully. Jul 22 20:52:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a36e4a9c-31cc-4e2a-9408-f04a8b3f3536 tempest-TestStampPattern-1081874420 None] Lock "cinder-6230d214-072f-4097-bf2b-98e86c83855a-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=18,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (920c703a-d082-4939-a30a-3b50f4be67b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719f7914-6750-4dc4-be33-c08bb9a700c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719f7914-6750-4dc4-be33-c08bb9a700c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946805372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c38824-f795-4df1-8eb0-3a24171d4787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:08Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1deca5-9e18-4410-9d84-000d08b6f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1deca5-9e18-4410-9d84-000d08b6f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a753551-1aaf-4980-99ff-92f68052a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a753551-1aaf-4980-99ff-92f68052a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c38824-f795-4df1-8eb0-3a24171d4787', 'volume_name': 'volume-94c38824-f795-4df1-8eb0-3a24171d4787', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5b2bd8-b89b-4a84-bff6-b524b27387b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5b2bd8-b89b-4a84-bff6-b524b27387b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8845a2a4-ed84-4149-b711-4d88d4195703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:07 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume 94c38824-f795-4df1-8eb0-3a24171d4787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c38824-f795-4df1-8eb0-3a24171d4787', 'volume_size': 1} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946805372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c38824-f795-4df1-8eb0-3a24171d4787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:08Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Creating volume 94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:07 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:07 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 1073741824 Jul 22 20:53:07 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:08 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 1073741824" returned: 0 in 0.407s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:08 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 Jul 22 20:53:08 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:08 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787" returned: 0 in 0.252s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8845a2a4-ed84-4149-b711-4d88d4195703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c38824-f795-4df1-8eb0-3a24171d4787', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c05e081-074f-4d43-9530-0ab827a333e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume volume-94c38824-f795-4df1-8eb0-3a24171d4787 (94c38824-f795-4df1-8eb0-3a24171d4787): created successfully Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c05e081-074f-4d43-9530-0ab827a333e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (920c703a-d082-4939-a30a-3b50f4be67b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0bb4d211-8444-45b2-9bf5-497416314b97 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created volume successfully. Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Creating offline snapshot 10539090-c0e1-4237-9c78-735197e07e13 of volume 94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f29c07-4ad5-4443-bbe5-a7bbea01181a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:09 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 Jul 22 20:53:09 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:09 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787" returned: 0 in 0.359s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:09 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 1G Jul 22 20:53:09 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:09 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 1G" returned: 0 in 0.393s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c38824-f795-4df1-8eb0-3a24171d4787 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:09 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c38824-f795-4df1-8eb0-3a24171d4787 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 Jul 22 20:53:09 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:10 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c38824-f795-4df1-8eb0-3a24171d4787 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:10 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 is being set with open permissions: ugo+rw Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:10 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 Jul 22 20:53:10 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:10 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:10 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.info Jul 22 20:53:10 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:10 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.info" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:10 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.info is being set with open permissions: ugo+rw Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:10 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.info Jul 22 20:53:10 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:10 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.info" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5f13fbcd-ba79-486b-97eb-6f5f15bda55b tempest-CreateVolumesFromSnapshotTest-1172861931 None] Create snapshot completed successfully Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (07686b65-e952-4b05-9341-807c9f2a2d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8ab2cb-04fe-4d90-9b0a-4cab36a308a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8ab2cb-04fe-4d90-9b0a-4cab36a308a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783552720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcb1146-291f-4bb1-b698-0320a0a40c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:11Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d697fef-c805-4af8-9b89-d736cf852e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d697fef-c805-4af8-9b89-d736cf852e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9f0013-8f7d-4fbb-bee1-0315f008d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9f0013-8f7d-4fbb-bee1-0315f008d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcb1146-291f-4bb1-b698-0320a0a40c3a', 'volume_name': 'volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50b8859-8025-4cec-9293-06a052a3e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50b8859-8025-4cec-9293-06a052a3e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be8ddf9-0412-49ec-982e-db97967008da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume fdcb1146-291f-4bb1-b698-0320a0a40c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a', 'volume_size': 1} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783552720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcb1146-291f-4bb1-b698-0320a0a40c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:11Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Creating volume fdcb1146-291f-4bb1-b698-0320a0a40c3a {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:11 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:11 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a 1073741824 Jul 22 20:53:11 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (307453a2-c548-41a9-be01-11f4e63a0858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d26676d-2c9f-4105-b616-ca772a5dcca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d26676d-2c9f-4105-b616-ca772a5dcca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720162489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64ce6f6-1d95-4320-8c02-4896abd9e20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:12Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c92ccb-75ee-47ef-a8ce-1a68ae5cfc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c92ccb-75ee-47ef-a8ce-1a68ae5cfc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02a2d01-5f50-4a69-8d9c-d8e94ec56afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02a2d01-5f50-4a69-8d9c-d8e94ec56afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e64ce6f6-1d95-4320-8c02-4896abd9e20f', 'volume_name': 'volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec26b62-224e-418d-ae07-199929956a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec26b62-224e-418d-ae07-199929956a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc229b-95fa-4585-9832-55665d1c932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume e64ce6f6-1d95-4320-8c02-4896abd9e20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f', 'volume_size': 1} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:12 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a 1073741824" returned: 0 in 0.487s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:12 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a Jul 22 20:53:12 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (088ac940-02dc-4b06-b18f-d352c8d790c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3bf7ae-b92a-40e4-9ff6-11407365bead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3bf7ae-b92a-40e4-9ff6-11407365bead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683245165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8883a6-bfda-4190-89f1-392e05b0690f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:12Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5ce65e-5cec-4d2d-8ab1-a4f22d5979c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5ce65e-5cec-4d2d-8ab1-a4f22d5979c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17eccde8-a75a-4152-aa87-5f4b7482ef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17eccde8-a75a-4152-aa87-5f4b7482ef8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8883a6-bfda-4190-89f1-392e05b0690f', 'volume_name': 'volume-3a8883a6-bfda-4190-89f1-392e05b0690f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f55f8c1-26bc-4982-908f-930743924bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f55f8c1-26bc-4982-908f-930743924bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c42196-de6b-4cd1-b376-63e7325f99b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume 3a8883a6-bfda-4190-89f1-392e05b0690f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8883a6-bfda-4190-89f1-392e05b0690f', 'volume_size': 1} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:12 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a" returned: 0 in 0.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720162489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64ce6f6-1d95-4320-8c02-4896abd9e20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:12Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Creating volume e64ce6f6-1d95-4320-8c02-4896abd9e20f {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:12 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be8ddf9-0412-49ec-982e-db97967008da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aac099-706e-4a1c-817f-08932da1f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f 1073741824 Jul 22 20:53:12 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a (fdcb1146-291f-4bb1-b698-0320a0a40c3a): created successfully Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aac099-706e-4a1c-817f-08932da1f43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (07686b65-e952-4b05-9341-807c9f2a2d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b04d99cd-5eb5-4302-9869-1278b72b29ba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created volume successfully. Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (3db0928e-98f0-4643-a962-db126e1008db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cdd2bd-819e-4e20-ab4f-069909ca06b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cdd2bd-819e-4e20-ab4f-069909ca06b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457504938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b11da06-7cd4-46c4-ae24-6f45c844d0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:13Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d6b5b7-e9df-4fe1-bebe-b418f6f7bf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d6b5b7-e9df-4fe1-bebe-b418f6f7bf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea38a8e4-e08d-4175-a269-499190b2c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea38a8e4-e08d-4175-a269-499190b2c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b11da06-7cd4-46c4-ae24-6f45c844d0e6', 'volume_name': 'volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501e9fe7-ed5f-4fb6-8181-bd3e5ce5d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501e9fe7-ed5f-4fb6-8181-bd3e5ce5d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84498829-c17f-4f7c-beb5-b5bf979d0983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume 1b11da06-7cd4-46c4-ae24-6f45c844d0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6', 'volume_size': 1} Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:12 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f 1073741824" returned: 0 in 0.541s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (84bdff98-b9d8-40ce-a795-5d5fb7f93246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd02419d-27c6-48d1-8bf5-367ef68e58e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd02419d-27c6-48d1-8bf5-367ef68e58e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151035343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6885d25-5ac4-4909-adc7-f068c65974c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:13Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef750085-14ea-4556-855f-1ddaaa336222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef750085-14ea-4556-855f-1ddaaa336222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b57571-abb2-45dc-94e2-de3bb8864a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b57571-abb2-45dc-94e2-de3bb8864a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6885d25-5ac4-4909-adc7-f068c65974c3', 'volume_name': 'volume-b6885d25-5ac4-4909-adc7-f068c65974c3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5534c3-d934-498c-9114-a97d25cafe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5534c3-d934-498c-9114-a97d25cafe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176b5ae-138c-4382-a50d-0fdcf80edc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume b6885d25-5ac4-4909-adc7-f068c65974c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6885d25-5ac4-4909-adc7-f068c65974c3', 'volume_size': 1} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:13 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f Jul 22 20:53:13 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:13 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f" returned: 0 in 0.245s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683245165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8883a6-bfda-4190-89f1-392e05b0690f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:12Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Creating volume 3a8883a6-bfda-4190-89f1-392e05b0690f {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:13 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc229b-95fa-4585-9832-55665d1c932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:13 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f 1073741824 Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e87b6d4-a679-4008-9109-90d944a4a88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:13 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f (e64ce6f6-1d95-4320-8c02-4896abd9e20f): created successfully Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e87b6d4-a679-4008-9109-90d944a4a88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (307453a2-c548-41a9-be01-11f4e63a0858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a618b15e-9cf4-449d-8afd-fb3021147f6c tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created volume successfully. Jul 22 20:53:13 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f 1073741824" returned: 0 in 0.403s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:13 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f Jul 22 20:53:13 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:14 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f" returned: 0 in 0.250s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.325s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457504938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b11da06-7cd4-46c4-ae24-6f45c844d0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:13Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Creating volume 1b11da06-7cd4-46c4-ae24-6f45c844d0e6 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:14 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c42196-de6b-4cd1-b376-63e7325f99b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8883a6-bfda-4190-89f1-392e05b0690f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:14 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 1073741824 Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709ca48d-4363-4d43-8137-c167b389f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:14 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume volume-3a8883a6-bfda-4190-89f1-392e05b0690f (3a8883a6-bfda-4190-89f1-392e05b0690f): created successfully Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709ca48d-4363-4d43-8137-c167b389f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (088ac940-02dc-4b06-b18f-d352c8d790c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-278bd94c-a410-466d-9dc5-b78994a0bf4d tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created volume successfully. Jul 22 20:53:14 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 1073741824" returned: 0 in 0.423s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:14 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 Jul 22 20:53:14 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:14 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151035343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6885d25-5ac4-4909-adc7-f068c65974c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669f7a922649efb3843589aa737d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:13Z,use_quota=True,user_id='92e817ad1e0541bcbb752e55e77e1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Creating volume b6885d25-5ac4-4909-adc7-f068c65974c3 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:14 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84498829-c17f-4f7c-beb5-b5bf979d0983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:14 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 1073741824 Jul 22 20:53:14 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9691593b-ff68-4dda-9632-bdab54d1d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 (1b11da06-7cd4-46c4-ae24-6f45c844d0e6): created successfully Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9691593b-ff68-4dda-9632-bdab54d1d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (3db0928e-98f0-4643-a962-db126e1008db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-af0dcb9d-3830-4263-901e-daf5be73d8e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created volume successfully. Jul 22 20:53:15 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 1073741824" returned: 0 in 0.420s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:15 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 Jul 22 20:53:15 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:15 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3" returned: 0 in 0.249s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176b5ae-138c-4382-a50d-0fdcf80edc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6885d25-5ac4-4909-adc7-f068c65974c3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce35317-db72-4ccb-9d4c-522e2da4e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:15 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Volume volume-b6885d25-5ac4-4909-adc7-f068c65974c3 (b6885d25-5ac4-4909-adc7-f068c65974c3): created successfully Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce35317-db72-4ccb-9d4c-522e2da4e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Flow 'volume_create_manager' (84bdff98-b9d8-40ce-a795-5d5fb7f93246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0ec6205e-d29d-44b6-a356-1af770655dba tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created volume successfully. Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-b6885d25-5ac4-4909-adc7-f068c65974c3-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-b6885d25-5ac4-4909-adc7-f068c65974c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-b6885d25-5ac4-4909-adc7-f068c65974c3" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-b6885d25-5ac4-4909-adc7-f068c65974c3" acquired by "delete_volume" :: waited 0.012s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bdfdc9-7fe6-479b-9473-e6b9ab088f3b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:16 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 Jul 22 20:53:16 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:16 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3" returned: 0 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:16 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3 Jul 22 20:53:16 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:17 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b6885d25-5ac4-4909-adc7-f068c65974c3" returned: 0 in 0.251s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-b6885d25-5ac4-4909-adc7-f068c65974c3" released by "delete_volume" :: held 0.641s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created reservations ['e0ba3d82-47c0-44df-b745-0a89bedb3500', '7df51911-7f15-4387-afda-d05f8a9fa844', '5ec10cb7-d6b8-4493-855b-8cb02a6afd89', 'e5f857fd-f827-4e12-ac09-6d60ac6a545b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:17 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:17 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:17 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.236s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Deleted volume successfully. Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4fa2fdd1-eb26-41d6-acd5-b26b3e5d0fc3 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-b6885d25-5ac4-4909-adc7-f068c65974c3-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-1b11da06-7cd4-46c4-ae24-6f45c844d0e6-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-1b11da06-7cd4-46c4-ae24-6f45c844d0e6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-1b11da06-7cd4-46c4-ae24-6f45c844d0e6" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-1b11da06-7cd4-46c4-ae24-6f45c844d0e6" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab6afb-d7f2-4265-bf3d-f65878ae16fc]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:17 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 Jul 22 20:53:17 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:18 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6" returned: 0 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:18 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6 Jul 22 20:53:18 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:18 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-1b11da06-7cd4-46c4-ae24-6f45c844d0e6" returned: 0 in 0.246s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-1b11da06-7cd4-46c4-ae24-6f45c844d0e6" released by "delete_volume" :: held 0.640s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created reservations ['264bf795-22ac-42c0-9b2f-e0c074871cce', 'c107369f-c62a-446c-9eb2-a9476b951acc', '431c5e53-8414-4b65-9576-8589f4fc7125', '2d009974-a60a-46ff-ac6b-8b4ffa65273f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:18 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:18 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:18 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.248s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Deleted volume successfully. Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cebf9fcf-26ad-45a3-9467-1c2dea318df5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-1b11da06-7cd4-46c4-ae24-6f45c844d0e6-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-3a8883a6-bfda-4190-89f1-392e05b0690f-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-3a8883a6-bfda-4190-89f1-392e05b0690f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-3a8883a6-bfda-4190-89f1-392e05b0690f" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-3a8883a6-bfda-4190-89f1-392e05b0690f" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f83b6c5-632c-40d7-b282-e3761256c856]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:18 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f Jul 22 20:53:18 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:19 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f" returned: 0 in 0.347s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:19 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f Jul 22 20:53:19 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:19 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-3a8883a6-bfda-4190-89f1-392e05b0690f" returned: 0 in 0.237s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-3a8883a6-bfda-4190-89f1-392e05b0690f" released by "delete_volume" :: held 0.621s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created reservations ['e1a6fe0b-2c42-4dbe-afbd-2c2ebe02b00e', '0d9f63c3-a449-4fc7-b9c9-228bb734d525', '291c6dcc-95c3-4626-b1bd-bc4be35d8bd8', 'c2be647f-5bdd-4a09-bb84-831f008f6f1c'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:19 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:19 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:19 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.245s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Deleted volume successfully. Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-cafa2d1e-ad24-48bf-aeb9-87b70069a0e5 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-3a8883a6-bfda-4190-89f1-392e05b0690f-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-e64ce6f6-1d95-4320-8c02-4896abd9e20f-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-e64ce6f6-1d95-4320-8c02-4896abd9e20f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-e64ce6f6-1d95-4320-8c02-4896abd9e20f" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-e64ce6f6-1d95-4320-8c02-4896abd9e20f" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c9671-4772-407d-a3fd-cd99da75d303]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:20 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f Jul 22 20:53:20 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:20 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f" returned: 0 in 0.347s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:20 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f Jul 22 20:53:20 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:20 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e64ce6f6-1d95-4320-8c02-4896abd9e20f" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-e64ce6f6-1d95-4320-8c02-4896abd9e20f" released by "delete_volume" :: held 0.625s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created reservations ['6d5a5b5c-de72-4e04-9156-2c6c38a3c26b', 'baeb4ee6-a8db-4fbc-91e4-bb8ba63b17c7', '693b2dee-6a9b-47a4-bb1a-c513f161ce7c', 'f9bd91cf-2fbf-4fdd-9671-e683b258e97e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:20 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:20 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:20 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:20 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Deleted volume successfully. Jul 22 20:53:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d6826f42-36d7-46f7-80cc-1dff705690f9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-e64ce6f6-1d95-4320-8c02-4896abd9e20f-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-fdcb1146-291f-4bb1-b698-0320a0a40c3a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-fdcb1146-291f-4bb1-b698-0320a0a40c3a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-fdcb1146-291f-4bb1-b698-0320a0a40c3a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-fdcb1146-291f-4bb1-b698-0320a0a40c3a" acquired by "delete_volume" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55c0d7b-8c68-4e4a-ad8f-71e02c1ba0d7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:21 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a Jul 22 20:53:21 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:21 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a" returned: 0 in 0.340s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:21 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a Jul 22 20:53:21 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:21 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fdcb1146-291f-4bb1-b698-0320a0a40c3a" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-fdcb1146-291f-4bb1-b698-0320a0a40c3a" released by "delete_volume" :: held 0.618s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created reservations ['e5b9aa6f-4b75-4870-9882-a25bda914443', 'b4cb7572-bcf3-45d3-bcf4-0898dd8b8723', '447093a3-3371-4fe4-864e-ee5f31530860', '2e965cae-f385-4ac8-abea-610066cb3f89'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:21 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:21 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:22 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.239s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Deleted volume successfully. Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a0afb6ff-3415-45ab-9191-d191caff7ee9 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-fdcb1146-291f-4bb1-b698-0320a0a40c3a-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-10539090-c0e1-4237-9c78-735197e07e13-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-10539090-c0e1-4237-9c78-735197e07e13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-94c38824-f795-4df1-8eb0-3a24171d4787" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-94c38824-f795-4df1-8eb0-3a24171d4787" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-10539090-c0e1-4237-9c78-735197e07e13" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-10539090-c0e1-4237-9c78-735197e07e13" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Deleting offline snapshot 10539090-c0e1-4237-9c78-735197e07e13 of volume 94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] snapshot_file for this snap is: volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c779c-b7bb-4c7c-987a-9ff3f179578d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:22 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 Jul 22 20:53:22 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:22 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94c38824-f795-4df1-8eb0-3a24171d4787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[16849964-fa4d-4c84-9da6-8035ff0fcd5a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:22 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 Jul 22 20:53:22 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:22 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787" returned: 0 in 0.351s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:23 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 Jul 22 20:53:23 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:23 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13" returned: 0 in 0.335s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:23 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13 Jul 22 20:53:23 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:23 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787.10539090-c0e1-4237-9c78-735197e07e13" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-10539090-c0e1-4237-9c78-735197e07e13" released by "_delete_snapshot" :: held 1.372s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-94c38824-f795-4df1-8eb0-3a24171d4787" released by "delete_snapshot" :: held 1.393s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:23 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created reservations ['7aa24101-0640-4f82-af55-60f997c679a8', 'aa0efdc6-f997-4f04-913c-963491f771e8', '2028bdb6-423f-4a8d-93a3-55441de1fee8', '16bc5220-c5c1-4405-b993-ee4c0f0f57d4'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Delete snapshot completed successfully. Jul 22 20:53:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4b61df2-0151-41ed-a572-aefa086eb3ee tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-10539090-c0e1-4237-9c78-735197e07e13-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-94c38824-f795-4df1-8eb0-3a24171d4787-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-94c38824-f795-4df1-8eb0-3a24171d4787-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "cinder-quobyte-94c38824-f795-4df1-8eb0-3a24171d4787" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-94c38824-f795-4df1-8eb0-3a24171d4787" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[82375d8b-6503-42ca-80ec-0f7ffab666ca]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:24 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 Jul 22 20:53:24 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:24 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:24 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787 Jul 22 20:53:24 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:25 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-94c38824-f795-4df1-8eb0-3a24171d4787" returned: 0 in 0.245s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-quobyte-94c38824-f795-4df1-8eb0-3a24171d4787" released by "delete_volume" :: held 0.654s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Created reservations ['eeb3aa14-e60f-47ca-ad2f-10134229bf3e', '78c7c187-776e-4f13-905f-41bc7ed0ad0a', 'a6715ddd-bbe2-44a1-8910-076d92a2a22f', '0f98276e-4979-444b-9600-9cfdf9549cd8'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:25 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:25 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:25 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.238s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Deleted volume successfully. Jul 22 20:53:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-45b47857-44bb-4240-9c2b-b6374ff26f45 tempest-CreateVolumesFromSnapshotTest-1172861931 None] Lock "cinder-94c38824-f795-4df1-8eb0-3a24171d4787-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Flow 'volume_create_manager' (d4322a26-f3e2-404d-b301-c81e2a2060e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbce29e7-6000-4837-accf-323214f9c793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbce29e7-6000-4837-accf-323214f9c793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323ec3cf-d8ba-4ed2-898a-4480a311f99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd12ba1f1b4491982995ff21d900d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:28Z,use_quota=True,user_id='9309310020db438b96d0074aa6fa7063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c73009-6671-4263-971c-7c1405ce7612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c73009-6671-4263-971c-7c1405ce7612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f72f70-6fa2-41cd-8b6d-85ef3c86b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f72f70-6fa2-41cd-8b6d-85ef3c86b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323ec3cf-d8ba-4ed2-898a-4480a311f99f', 'volume_name': 'volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387dc2b-de33-4220-9e30-3e72b128497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387dc2b-de33-4220-9e30-3e72b128497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8204afff-11f5-4201-89c0-100387202f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Volume 323ec3cf-d8ba-4ed2-898a-4480a311f99f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f', 'volume_size': 1} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323ec3cf-d8ba-4ed2-898a-4480a311f99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd12ba1f1b4491982995ff21d900d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:28Z,use_quota=True,user_id='9309310020db438b96d0074aa6fa7063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Creating volume 323ec3cf-d8ba-4ed2-898a-4480a311f99f {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:28 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:28 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f 1073741824 Jul 22 20:53:28 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:28 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f 1073741824" returned: 0 in 0.412s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:28 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f Jul 22 20:53:28 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:28 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f" returned: 0 in 0.243s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8204afff-11f5-4201-89c0-100387202f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8006ca22-d025-4b98-9ba1-bbccb5c6733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Volume volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f (323ec3cf-d8ba-4ed2-898a-4480a311f99f): created successfully Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8006ca22-d025-4b98-9ba1-bbccb5c6733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Flow 'volume_create_manager' (d4322a26-f3e2-404d-b301-c81e2a2060e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6cb97e1c-619e-402f-bd85-c88356b65501 tempest-CinderUnicodeTest-1027532663 None] Created volume successfully. Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Flow 'volume_create_manager' (b57ddde9-6c8e-41f3-abf3-67b897a06f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad74b5c-c8b6-43be-bf15-08f770233462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad74b5c-c8b6-43be-bf15-08f770233462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-858995367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60bfec3-7393-4088-927b-33b1bf5d65c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd12ba1f1b4491982995ff21d900d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:30Z,use_quota=True,user_id='9309310020db438b96d0074aa6fa7063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a359f312-99ba-4ab0-a8ca-cc89ebd3e670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a359f312-99ba-4ab0-a8ca-cc89ebd3e670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb89ba42-ba28-4115-87ba-08c257a4f967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb89ba42-ba28-4115-87ba-08c257a4f967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60bfec3-7393-4088-927b-33b1bf5d65c7', 'volume_name': 'volume-a60bfec3-7393-4088-927b-33b1bf5d65c7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dc9f56-4d05-43ec-9df0-a4e2c4af3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dc9f56-4d05-43ec-9df0-a4e2c4af3a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8334bf56-0d3a-4916-92f2-71369ad18712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:29 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Volume a60bfec3-7393-4088-927b-33b1bf5d65c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60bfec3-7393-4088-927b-33b1bf5d65c7', 'volume_size': 1} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-858995367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60bfec3-7393-4088-927b-33b1bf5d65c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd12ba1f1b4491982995ff21d900d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:30Z,use_quota=True,user_id='9309310020db438b96d0074aa6fa7063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Creating volume a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:29 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:29 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 1073741824 Jul 22 20:53:29 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:30 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 1073741824" returned: 0 in 0.421s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:30 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 Jul 22 20:53:30 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:30 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8334bf56-0d3a-4916-92f2-71369ad18712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60bfec3-7393-4088-927b-33b1bf5d65c7', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c416e3-2a2a-4eae-8c8e-2413e0d2bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:30 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Volume volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 (a60bfec3-7393-4088-927b-33b1bf5d65c7): created successfully Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c416e3-2a2a-4eae-8c8e-2413e0d2bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Flow 'volume_create_manager' (b57ddde9-6c8e-41f3-abf3-67b897a06f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f5d9590d-d200-4775-a2ee-e19963c8c150 tempest-CinderUnicodeTest-1027532663 None] Created volume successfully. Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Creating offline snapshot d780339b-7e1f-4333-80c2-69fbf1a691fc of volume a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3400e808-41e9-4be8-a9ae-6d9336ed9eb6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:30 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 Jul 22 20:53:30 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:31 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7" returned: 0 in 0.354s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:31 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc 1G Jul 22 20:53:31 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:31 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc 1G" returned: 0 in 0.383s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:31 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc Jul 22 20:53:31 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:31 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc" returned: 0 in 0.289s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:31 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc is being set with open permissions: ugo+rw Jul 22 20:53:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:31 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc Jul 22 20:53:31 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:32 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:32 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.info Jul 22 20:53:32 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:32 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.info" returned: 0 in 0.253s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:32 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.info is being set with open permissions: ugo+rw Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:32 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.info Jul 22 20:53:32 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:32 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.info" returned: 0 in 0.246s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d5d0e05f-e800-46ac-b925-b29a8834e454 tempest-CinderUnicodeTest-1027532663 None] Create snapshot completed successfully Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "cinder-d780339b-7e1f-4333-80c2-69fbf1a691fc-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-d780339b-7e1f-4333-80c2-69fbf1a691fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "cinder-quobyte-a60bfec3-7393-4088-927b-33b1bf5d65c7" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-a60bfec3-7393-4088-927b-33b1bf5d65c7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "cinder-quobyte-d780339b-7e1f-4333-80c2-69fbf1a691fc" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-d780339b-7e1f-4333-80c2-69fbf1a691fc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Deleting offline snapshot d780339b-7e1f-4333-80c2-69fbf1a691fc of volume a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] snapshot_file for this snap is: volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14d923d-dc2d-4834-b460-3aae715b849a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:33 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc Jul 22 20:53:33 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:33 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc" returned: 0 in 0.357s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60bfec3-7393-4088-927b-33b1bf5d65c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9255b9-70cb-4bb8-a3e1-5451508cae0c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:33 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 Jul 22 20:53:33 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:33 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7" returned: 0 in 0.349s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:33 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc Jul 22 20:53:33 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:34 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc" returned: 0 in 0.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:34 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc Jul 22 20:53:34 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:34 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7.d780339b-7e1f-4333-80c2-69fbf1a691fc" returned: 0 in 0.247s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-d780339b-7e1f-4333-80c2-69fbf1a691fc" released by "_delete_snapshot" :: held 1.383s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-a60bfec3-7393-4088-927b-33b1bf5d65c7" released by "delete_snapshot" :: held 1.403s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:34 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Created reservations ['8ebe5d7d-cdd7-421e-8cd0-ee44a25f00be', '07aac19e-c654-4540-8bf8-55ab730c9f5c', '542ee0aa-c002-4053-9c2d-a8ee2eb1c38a', '818ce302-a584-4748-aa39-510eb4395855'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:34 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Delete snapshot completed successfully. Jul 22 20:53:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bdd4ba93-01a5-4a36-837f-e0bcc57d452c tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-d780339b-7e1f-4333-80c2-69fbf1a691fc-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "cinder-a60bfec3-7393-4088-927b-33b1bf5d65c7-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-a60bfec3-7393-4088-927b-33b1bf5d65c7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "cinder-quobyte-a60bfec3-7393-4088-927b-33b1bf5d65c7" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-a60bfec3-7393-4088-927b-33b1bf5d65c7" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d03a265-5e56-47d6-8717-705963e8ef72]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:35 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 Jul 22 20:53:35 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:35 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7" returned: 0 in 0.358s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:35 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7 Jul 22 20:53:35 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:35 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a60bfec3-7393-4088-927b-33b1bf5d65c7" returned: 0 in 0.239s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-a60bfec3-7393-4088-927b-33b1bf5d65c7" released by "delete_volume" :: held 0.653s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Created reservations ['688b5a04-6efc-4ec4-b279-54f6836bedd0', 'aaefa53e-7f0f-477b-97d6-0bf1b81d5801', '43f8a375-b257-47a2-9dc2-f332d5c152fa', 'de1364b3-f877-422b-ba97-4ff169629541'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:35 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:35 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:36 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.235s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Deleted volume successfully. Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b7b187cc-aefe-48f7-b6ef-89e270749496 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-a60bfec3-7393-4088-927b-33b1bf5d65c7-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "cinder-323ec3cf-d8ba-4ed2-898a-4480a311f99f-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-323ec3cf-d8ba-4ed2-898a-4480a311f99f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "cinder-quobyte-323ec3cf-d8ba-4ed2-898a-4480a311f99f" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-323ec3cf-d8ba-4ed2-898a-4480a311f99f" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0af32e-b1cd-43a5-bbd7-fc7985bbeb34]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:36 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f Jul 22 20:53:36 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:36 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f" returned: 0 in 0.362s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:36 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f Jul 22 20:53:36 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:36 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-323ec3cf-d8ba-4ed2-898a-4480a311f99f" returned: 0 in 0.238s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-quobyte-323ec3cf-d8ba-4ed2-898a-4480a311f99f" released by "delete_volume" :: held 0.635s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:36 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Created reservations ['5a258619-492e-4f39-be1e-f6d0614606b8', '256fd89d-557b-4905-b838-673a941fc369', 'f9c7af6f-4040-4844-a425-bf2546c9b4ba', '79cc34fe-e0c3-4519-adf4-b24b5f907d7d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:37 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:37 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:37 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.246s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Deleted volume successfully. Jul 22 20:53:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7092b1f0-123a-4d5b-aded-1aa983610d83 tempest-CinderUnicodeTest-1027532663 None] Lock "cinder-323ec3cf-d8ba-4ed2-898a-4480a311f99f-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:41 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:41 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:41 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.252s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:53:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:53:47 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=80,cinder:INSERT=28,cinder:UPDATE=103,cinder:DELETE=5 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:53:47 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=101,cinder:SELECT=68,cinder:DELETE=13,cinder:INSERT=22 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:53:48 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (246dabf2-95fc-490e-b896-58ae251d59ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59253c52-7798-4e60-8e6a-cb7ca044a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59253c52-7798-4e60-8e6a-cb7ca044a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124777203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc00fb4-c639-47ea-8d26-4daa2fb93d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:49Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b40426d-9d68-425a-8d9d-90ddaa52eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b40426d-9d68-425a-8d9d-90ddaa52eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d675d1-ef99-464d-b725-5f70a703f2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d675d1-ef99-464d-b725-5f70a703f2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc00fb4-c639-47ea-8d26-4daa2fb93d07', 'volume_name': 'volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bff792-fff9-4508-ad6b-c1418e7b8c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bff792-fff9-4508-ad6b-c1418e7b8c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a59de2-fecb-44e7-bb0d-10726cd742ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume ecc00fb4-c639-47ea-8d26-4daa2fb93d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07', 'volume_size': 1} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124777203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc00fb4-c639-47ea-8d26-4daa2fb93d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:49Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Creating volume ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:49 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:49 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 1073741824 Jul 22 20:53:49 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (01b24a8f-bb5e-430c-b3e9-e197c4e871e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26eb783b-5275-4844-b92f-aed0a83d7f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26eb783b-5275-4844-b92f-aed0a83d7f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914353118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817f67e0-1cf8-400d-87cd-2a6d0ac9c408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:49Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cc2a34-64e9-4650-9697-0336de92e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cc2a34-64e9-4650-9697-0336de92e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abe74ef-99ad-4510-9293-1dd7ab4bccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abe74ef-99ad-4510-9293-1dd7ab4bccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817f67e0-1cf8-400d-87cd-2a6d0ac9c408', 'volume_name': 'volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b37f566-3cc5-47cf-afc5-1bac7b618d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b37f566-3cc5-47cf-afc5-1bac7b618d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e58649f-50a0-4421-b834-52427c73baf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Volume 817f67e0-1cf8-400d-87cd-2a6d0ac9c408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408', 'volume_size': 1} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (53e622f3-1541-4059-b387-74393331847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914c7f11-13de-4ac7-a3b4-b3e3b211c21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914c7f11-13de-4ac7-a3b4-b3e3b211c21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1247112008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403b1881-c674-4817-960e-bbfcc66202b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:49Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d6374a-0b30-49d7-bdcb-f30035d96883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d6374a-0b30-49d7-bdcb-f30035d96883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52833034-dbd8-4d55-bfab-ac446cdfe6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52833034-dbd8-4d55-bfab-ac446cdfe6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403b1881-c674-4817-960e-bbfcc66202b1', 'volume_name': 'volume-403b1881-c674-4817-960e-bbfcc66202b1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54223d72-99c4-4ad2-ba35-1e5addbf60f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54223d72-99c4-4ad2-ba35-1e5addbf60f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f784c6-f738-404a-b833-3b07a5a3ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Volume 403b1881-c674-4817-960e-bbfcc66202b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403b1881-c674-4817-960e-bbfcc66202b1', 'volume_size': 1} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:49 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 1073741824" returned: 0 in 0.630s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:49 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 Jul 22 20:53:49 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Flow 'volume_create_manager' (31b635c9-d0ee-4bf6-bcba-f0d3c61cfa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6497499-ef33-437c-b38d-5431f399b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" returned: 0 in 0.420s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914353118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817f67e0-1cf8-400d-87cd-2a6d0ac9c408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:49Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Creating volume 817f67e0-1cf8-400d-87cd-2a6d0ac9c408 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:50 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6497499-ef33-437c-b38d-5431f399b599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-335830307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7018d877-7c38-45dc-81b0-f1a59cfc31a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dafcdfb6616e43e2a6a0fed4e09d10f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:50Z,use_quota=True,user_id='723d4ba0f3fa44ecb9edf535fc2d808d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5abcdd-acdb-4526-ba62-287dd91d71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5abcdd-acdb-4526-ba62-287dd91d71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 1073741824 Jul 22 20:53:50 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483bfbcf-89b4-4303-b531-01e07bd99169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483bfbcf-89b4-4303-b531-01e07bd99169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7018d877-7c38-45dc-81b0-f1a59cfc31a3', 'volume_name': 'volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533806ca-56b1-4277-bc04-c45333ecafbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533806ca-56b1-4277-bc04-c45333ecafbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f722a9-7fd2-40d6-ac80-9989303023d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Volume 7018d877-7c38-45dc-81b0-f1a59cfc31a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3', 'volume_size': 1} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a59de2-fecb-44e7-bb0d-10726cd742ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59141c7-b382-4a82-a1a9-3c53729937e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (60e9c965-df4f-4d3b-8495-7c9493c73bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0befa3ff-ca09-47c3-99bd-3f18833a22df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 (ecc00fb4-c639-47ea-8d26-4daa2fb93d07): created successfully Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59141c7-b382-4a82-a1a9-3c53729937e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (246dabf2-95fc-490e-b896-58ae251d59ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0befa3ff-ca09-47c3-99bd-3f18833a22df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341883681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f221730a-f3f3-4060-9177-c998881793e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:50Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac98aa3-c9e0-478d-ba9a-93fc54cb15b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac98aa3-c9e0-478d-ba9a-93fc54cb15b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35253ef-0254-47c1-b0e8-f179cb250d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35253ef-0254-47c1-b0e8-f179cb250d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f221730a-f3f3-4060-9177-c998881793e4', 'volume_name': 'volume-f221730a-f3f3-4060-9177-c998881793e4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a87a55-9b88-486e-88f2-8b69792bc030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a87a55-9b88-486e-88f2-8b69792bc030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0153a0-257d-4508-8e7f-ef3bf24f3aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Volume f221730a-f3f3-4060-9177-c998881793e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f221730a-f3f3-4060-9177-c998881793e4', 'volume_size': 1} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-cdd361dc-8318-4925-855f-64e0277a1fd1 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created volume successfully. Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (808f1560-0362-455b-9153-4ade45389a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b411de-4b17-41fd-aa31-9f933fe846a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b411de-4b17-41fd-aa31-9f933fe846a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779457703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a0256b-15ea-4cc3-b100-edcf0a830f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:50Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233d6b03-e9b6-42e3-b7e7-7c2c6a8b1aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233d6b03-e9b6-42e3-b7e7-7c2c6a8b1aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dce532d-49f0-4326-9b3d-ca95f45d55d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dce532d-49f0-4326-9b3d-ca95f45d55d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a0256b-15ea-4cc3-b100-edcf0a830f15', 'volume_name': 'volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fa50cf-f808-40b5-9154-f8b07199d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fa50cf-f808-40b5-9154-f8b07199d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55ec94a-5118-4c44-bb71-36952d6f1988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Volume f2a0256b-15ea-4cc3-b100-edcf0a830f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15', 'volume_size': 1} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:50 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 1073741824" returned: 0 in 0.578s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (95013597-1cad-4ebe-a0f5-aa35a869ef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e4d863-d8f0-4ada-935f-d97a5cdf694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e4d863-d8f0-4ada-935f-d97a5cdf694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257268680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd433b1-9937-43f7-80ac-c3cda76326da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:51Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3722c-e37c-43f0-8a3c-1410225507e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb3722c-e37c-43f0-8a3c-1410225507e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c710866-45f2-4631-ad64-61bd92b37907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c710866-45f2-4631-ad64-61bd92b37907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd433b1-9937-43f7-80ac-c3cda76326da', 'volume_name': 'volume-fcd433b1-9937-43f7-80ac-c3cda76326da', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77a4b24-712e-471c-b74b-17de686ba7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77a4b24-712e-471c-b74b-17de686ba7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f85c27-82e9-4e86-aab8-30bf5f63679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:50 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Volume fcd433b1-9937-43f7-80ac-c3cda76326da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd433b1-9937-43f7-80ac-c3cda76326da', 'volume_size': 1} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:50 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 Jul 22 20:53:50 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:51 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408" returned: 0 in 0.298s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1247112008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403b1881-c674-4817-960e-bbfcc66202b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:49Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Creating volume 403b1881-c674-4817-960e-bbfcc66202b1 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:51 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e58649f-50a0-4421-b834-52427c73baf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25a7b83-1f9a-4dbe-b0b3-d7230caffcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:51 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 1073741824 Jul 22 20:53:51 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:51 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Volume volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 (817f67e0-1cf8-400d-87cd-2a6d0ac9c408): created successfully Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25a7b83-1f9a-4dbe-b0b3-d7230caffcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (01b24a8f-bb5e-430c-b3e9-e197c4e871e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:51 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b2e7a292-b030-4680-b66d-63c3dd384eaa tempest-CreateVolumesFromImageTest-564865564 None] Created volume successfully. Jul 22 20:53:51 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 1073741824" returned: 0 in 0.450s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:51 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 Jul 22 20:53:51 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:51 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1" returned: 0 in 0.275s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.702s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-335830307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7018d877-7c38-45dc-81b0-f1a59cfc31a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dafcdfb6616e43e2a6a0fed4e09d10f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:50Z,use_quota=True,user_id='723d4ba0f3fa44ecb9edf535fc2d808d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Creating volume 7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:51 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:51 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f784c6-f738-404a-b833-3b07a5a3ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403b1881-c674-4817-960e-bbfcc66202b1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c215bce-b463-4fb3-a965-6886c9e152d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:52 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 1073741824 Jul 22 20:53:52 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:52 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Volume volume-403b1881-c674-4817-960e-bbfcc66202b1 (403b1881-c674-4817-960e-bbfcc66202b1): created successfully Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c215bce-b463-4fb3-a965-6886c9e152d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (53e622f3-1541-4059-b387-74393331847b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6dccaac2-bd1d-4703-9e7e-e6e4cbd9c86a tempest-CreateVolumesFromImageTest-564865564 None] Created volume successfully. Jul 22 20:53:52 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 1073741824" returned: 0 in 0.461s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:52 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 Jul 22 20:53:52 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:52 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3" returned: 0 in 0.265s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.315s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341883681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f221730a-f3f3-4060-9177-c998881793e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:50Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Creating volume f221730a-f3f3-4060-9177-c998881793e4 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:52 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f722a9-7fd2-40d6-ac80-9989303023d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:52 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 1073741824 Jul 22 20:53:52 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f6e5f6-29f5-4a56-bcca-af7542565ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:52 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Volume volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 (7018d877-7c38-45dc-81b0-f1a59cfc31a3): created successfully Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f6e5f6-29f5-4a56-bcca-af7542565ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Flow 'volume_create_manager' (31b635c9-d0ee-4bf6-bcba-f0d3c61cfa6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:52 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e26c56fe-e11e-475d-bab2-9a6ceba4c559 tempest-VolumeDependencyTests-2090401825 None] Created volume successfully. Jul 22 20:53:53 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 1073741824" returned: 0 in 0.506s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:53 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 Jul 22 20:53:53 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Flow 'volume_create_manager' (4ca30c77-fc08-4e25-b664-c7c4dd74f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bd86d3-37a7-4b64-8660-41328fe0271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bd86d3-37a7-4b64-8660-41328fe0271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4212d8e-cde0-4ac6-b711-5492bd073d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947d115dcaa14323960bb25164ba165e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:53Z,use_quota=True,user_id='5c77c20ec7754694bd50823bea630e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1598c70c-9bfa-4c80-8b76-ca79851e17eb),volume_type_id=1598c70c-9bfa-4c80-8b76-ca79851e17eb)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3fb3c5-5d73-4064-8ba6-21e50e166bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3fb3c5-5d73-4064-8ba6-21e50e166bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed9f43e-ea31-4662-a492-1887870d1d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:53:53 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4" returned: 0 in 0.253s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779457703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a0256b-15ea-4cc3-b100-edcf0a830f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:50Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Creating volume f2a0256b-15ea-4cc3-b100-edcf0a830f15 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:53 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:53 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 1073741824 Jul 22 20:53:53 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0153a0-257d-4508-8e7f-ef3bf24f3aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f221730a-f3f3-4060-9177-c998881793e4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836adfd9-dd66-4575-808c-2eb8c7f0d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:53 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Volume volume-f221730a-f3f3-4060-9177-c998881793e4 (f221730a-f3f3-4060-9177-c998881793e4): created successfully Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836adfd9-dd66-4575-808c-2eb8c7f0d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (60e9c965-df4f-4d3b-8495-7c9493c73bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-950d8b46-5bdf-45dd-9174-b101b1aa8f88 tempest-CreateVolumesFromImageTest-564865564 None] Created volume successfully. Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed9f43e-ea31-4662-a492-1887870d1d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4212d8e-cde0-4ac6-b711-5492bd073d49', 'volume_name': 'volume-f4212d8e-cde0-4ac6-b711-5492bd073d49', 'volume_size': 1, 'image_id': '94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '175fe54aaef68391d351c236464b8d89', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '947d115dcaa14323960bb25164ba165e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '584122cc37a05872b3cdd11bdde14a99e485d8a2369a8dc338a233d32eb56c31474d98362e4a45bc768884e18f0eaddaf446cb41a1244bbdad3e6dd97f473908', 'id': '94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'created_at': datetime.datetime(2026, 7, 22, 18, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 53, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacea966-3903-4058-bbe8-56c7ae628a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacea966-3903-4058-bbe8-56c7ae628a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe38866a-5b20-41ff-a0e1-ca9c45802081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:53 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Volume f4212d8e-cde0-4ac6-b711-5492bd073d49: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4212d8e-cde0-4ac6-b711-5492bd073d49', 'volume_size': 1, 'image_id': '94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '175fe54aaef68391d351c236464b8d89', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '947d115dcaa14323960bb25164ba165e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '584122cc37a05872b3cdd11bdde14a99e485d8a2369a8dc338a233d32eb56c31474d98362e4a45bc768884e18f0eaddaf446cb41a1244bbdad3e6dd97f473908', 'id': '94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'created_at': datetime.datetime(2026, 7, 22, 18, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 53, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Trying to clone f4212d8e-cde0-4ac6-b711-5492bd073d49 from image 94a640c8-ceb6-44de-a4de-e2bfa90bb317 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:53:53 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Image download 0.00 MB at 0.00 MB/s Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[06986939-725c-4c31-8c8b-3eb764ed09e0]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:54 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD Jul 22 20:53:54 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:54 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 1073741824" returned: 0 in 0.582s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:54 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 Jul 22 20:53:54 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:54 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:54 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15" returned: 0 in 0.251s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.557s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257268680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd433b1-9937-43f7-80ac-c3cda76326da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b8a2b448664e16bb3f71f7ffa9821c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:51Z,use_quota=True,user_id='51aba81e7b204a5b98b93e46ba62460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Creating volume fcd433b1-9937-43f7-80ac-c3cda76326da {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:54 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:54 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55ec94a-5118-4c44-bb71-36952d6f1988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:54 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2336d5-e057-4396-b1ba-e905ebf1f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:54 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da 1073741824 Jul 22 20:53:54 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:54 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Volume volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 (f2a0256b-15ea-4cc3-b100-edcf0a830f15): created successfully Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2336d5-e057-4396-b1ba-e905ebf1f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (808f1560-0362-455b-9153-4ade45389a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:54 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-12a0b9ab-c67f-46a9-95c3-4304e3d2ac21 tempest-CreateVolumesFromImageTest-564865564 None] Created volume successfully. Jul 22 20:53:54 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Temporary image 94a640c8-ceb6-44de-a4de-e2bfa90bb317 is fetched for user 5c77c20ec7754694bd50823bea630e7a. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d61949-6afb-47aa-97c8-ea8f42d31457]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:54 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD Jul 22 20:53:54 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:54 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da 1073741824" returned: 0 in 0.461s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:54 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da Jul 22 20:53:54 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:55 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:55 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.023s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f85c27-82e9-4e86-aab8-30bf5f63679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd433b1-9937-43f7-80ac-c3cda76326da', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c68de6b-e687-4ac6-855e-486443faf86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Creating offline snapshot ae830d5c-0e8c-4a05-aa1a-55250c4c8545 of volume ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:53:55 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Volume volume-fcd433b1-9937-43f7-80ac-c3cda76326da (fcd433b1-9937-43f7-80ac-c3cda76326da): created successfully Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c68de6b-e687-4ac6-855e-486443faf86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Flow 'volume_create_manager' (95013597-1cad-4ebe-a0f5-aa35a869ef4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:55 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD Jul 22 20:53:55 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6380ea69-0462-4069-8ab9-cb675e5419e6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7e554565-0402-45a3-b14f-59353232059d tempest-CreateVolumesFromImageTest-564865564 None] Created volume successfully. Jul 22 20:53:55 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 Jul 22 20:53:55 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:55 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:55 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" returned: 0 in 0.381s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:55 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 1G Jul 22 20:53:55 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:56 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 1G" returned: 0 in 0.389s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:56 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 Jul 22 20:53:56 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:56 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545" returned: 0 in 0.304s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:56 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 is being set with open permissions: ugo+rw Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-fcd433b1-9937-43f7-80ac-c3cda76326da-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:56 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 Jul 22 20:53:56 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-fcd433b1-9937-43f7-80ac-c3cda76326da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-quobyte-fcd433b1-9937-43f7-80ac-c3cda76326da" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-fcd433b1-9937-43f7-80ac-c3cda76326da" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cabb41-9e2c-4deb-9738-b2470136578b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:56 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da Jul 22 20:53:56 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:56 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:56 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.info Jul 22 20:53:56 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:56 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da" returned: 0 in 0.372s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:56 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da Jul 22 20:53:56 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:56 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.info" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:56 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.info is being set with open permissions: ugo+rw Jul 22 20:53:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:56 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.info Jul 22 20:53:56 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:57 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-fcd433b1-9937-43f7-80ac-c3cda76326da" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-fcd433b1-9937-43f7-80ac-c3cda76326da" released by "delete_volume" :: held 0.662s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:57 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.info" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Created reservations ['35a8b13a-421f-4fc8-b4c0-520d20cbf71c', '4b728d9e-cc34-42f6-a4d4-e0f5492ce012', '6c960333-febe-4ac0-ab37-6106e828a012', 'fa1f3f69-7b47-4251-996d-e6ad9d87e154'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Creating offline snapshot 4c159a01-d0a7-44af-96d7-150da0ec9411 of volume 7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63f15ca-c9c8-4675-bb94-c208495981d2]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2a72a291-5d28-45c3-b142-367407e29422 tempest-CreateVolumesFromSnapshotTest-315546512 None] Create snapshot completed successfully Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:57 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:57 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:57 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 Jul 22 20:53:57 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:57 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.264s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Deleted volume successfully. Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-76baac61-15bd-4316-a82c-3fa18f6cd905 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-fcd433b1-9937-43f7-80ac-c3cda76326da-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-f2a0256b-15ea-4cc3-b100-edcf0a830f15-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-f2a0256b-15ea-4cc3-b100-edcf0a830f15-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-quobyte-f2a0256b-15ea-4cc3-b100-edcf0a830f15" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:57 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3" returned: 0 in 0.478s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-f2a0256b-15ea-4cc3-b100-edcf0a830f15" acquired by "delete_volume" :: waited 0.040s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:57 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 1G Jul 22 20:53:57 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ce625-16c8-4ae6-93bf-d2f246327c2a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:57 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 Jul 22 20:53:57 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (2631621c-8cec-4d7c-8f85-beee353f8268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edceea73-d4ba-467c-a678-9b16bf1a4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edceea73-d4ba-467c-a678-9b16bf1a4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222218442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a69c7e7-cd34-4af5-aca8-04cf15477a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:58Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53ab12d-46da-4818-ba3c-52a1473f67ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53ab12d-46da-4818-ba3c-52a1473f67ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107bf319-2101-46bd-b870-f36f77153b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107bf319-2101-46bd-b870-f36f77153b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a69c7e7-cd34-4af5-aca8-04cf15477a91', 'volume_name': 'volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6586cb6-8989-409d-b7bf-242302806dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6586cb6-8989-409d-b7bf-242302806dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5205d648-081c-4601-ad26-f6d1c629af8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume 2a69c7e7-cd34-4af5-aca8-04cf15477a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91', 'volume_size': 1} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:58 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15" returned: 0 in 0.456s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:58 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 1G" returned: 0 in 0.523s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:58 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15 Jul 22 20:53:58 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:58 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 Jul 22 20:53:58 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (b5733648-664d-49ca-8c53-6cf91121ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baa0a0d-5e9d-4325-ad58-6364658c7dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baa0a0d-5e9d-4325-ad58-6364658c7dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609817623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110511a2-12a5-4ca7-9771-4a3935e836d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:58Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbf82a0-482b-4904-85b2-4c7981a6b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbf82a0-482b-4904-85b2-4c7981a6b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920382a4-76e3-4528-9eed-05a0d7c2d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920382a4-76e3-4528-9eed-05a0d7c2d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110511a2-12a5-4ca7-9771-4a3935e836d8', 'volume_name': 'volume-110511a2-12a5-4ca7-9771-4a3935e836d8', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dd5821-6888-4b76-81a9-94f51fa911d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dd5821-6888-4b76-81a9-94f51fa911d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cf62d9-cdf8-4e9f-bab1-cf5969fd67a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume 110511a2-12a5-4ca7-9771-4a3935e836d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110511a2-12a5-4ca7-9771-4a3935e836d8', 'volume_size': 1} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f2a0256b-15ea-4cc3-b100-edcf0a830f15" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-f2a0256b-15ea-4cc3-b100-edcf0a830f15" released by "delete_volume" :: held 0.874s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:58 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411" returned: 0 in 0.386s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:58 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 is being set with open permissions: ugo+rw Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:58 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 Jul 22 20:53:58 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Created reservations ['9fd5a95c-a0e1-4a16-af5b-0e529e4eb677', 'c31d5d55-2009-4a65-b5ae-bd3ad6507991', '60446b3d-9611-40c0-b497-ca738d20b74e', '98733eea-8e20-4e1f-a57d-27e85b667d69'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:58 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:53:58 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-f221730a-f3f3-4060-9177-c998881793e4-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-f221730a-f3f3-4060-9177-c998881793e4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:58 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (13baff23-8b24-4d5c-a034-2de4660db102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2e3872-511f-4216-92d9-5d95fb153264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411" returned: 0 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:58 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2e3872-511f-4216-92d9-5d95fb153264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021558468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdb68ed-fae3-454a-bc04-563a64130e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:59Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2e8ada-cd9c-43c6-8b8a-4a16aa8f8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2e8ada-cd9c-43c6-8b8a-4a16aa8f8377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74acbddc-d7dc-4830-9b64-351589d8414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74acbddc-d7dc-4830-9b64-351589d8414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cdb68ed-fae3-454a-bc04-563a64130e5b', 'volume_name': 'volume-9cdb68ed-fae3-454a-bc04-563a64130e5b', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64232a5-bc3a-416b-9ef8-7c523d25d6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64232a5-bc3a-416b-9ef8-7c523d25d6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3743c9b7-a1c0-49a8-8800-d76e2a1151fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume 9cdb68ed-fae3-454a-bc04-563a64130e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cdb68ed-fae3-454a-bc04-563a64130e5b', 'volume_size': 1} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:53:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Deleted volume successfully. Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-quobyte-f221730a-f3f3-4060-9177-c998881793e4" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-f221730a-f3f3-4060-9177-c998881793e4" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2fb4e68e-af89-4c3b-8998-6c1417dc2440 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-f2a0256b-15ea-4cc3-b100-edcf0a830f15-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1655818-a899-481b-8fb1-a4829f143a6c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:59 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.info Jul 22 20:53:59 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:59 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 Jul 22 20:53:59 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (9dcf7fcf-90ff-461e-aedb-ffc693d7501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716b9672-a81f-4c8a-be02-ddf224827877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716b9672-a81f-4c8a-be02-ddf224827877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1842383754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853e6125-12eb-4ef8-afbc-6f9134d72832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:59Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b620bed5-6060-4573-ba1f-94f7eed42df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b620bed5-6060-4573-ba1f-94f7eed42df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691dfee9-68b9-4af6-a896-3443d3326bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691dfee9-68b9-4af6-a896-3443d3326bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853e6125-12eb-4ef8-afbc-6f9134d72832', 'volume_name': 'volume-853e6125-12eb-4ef8-afbc-6f9134d72832', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ee3fd3-ae66-4ca9-9022-69a7503a5eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ee3fd3-ae66-4ca9-9022-69a7503a5eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11eddaa1-8e6f-4e67-b38f-2c45a7ce5e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume 853e6125-12eb-4ef8-afbc-6f9134d72832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853e6125-12eb-4ef8-afbc-6f9134d72832', 'volume_size': 1} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.info" returned: 0 in 0.350s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:59 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.info is being set with open permissions: ugo+rw Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:59 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.info Jul 22 20:53:59 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:59 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4" returned: 0 in 0.441s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:59 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4 Jul 22 20:53:59 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:59 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.info" returned: 0 in 0.290s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.301s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4212d8e-cde0-4ac6-b711-5492bd073d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947d115dcaa14323960bb25164ba165e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:53Z,use_quota=True,user_id='5c77c20ec7754694bd50823bea630e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1598c70c-9bfa-4c80-8b76-ca79851e17eb),volume_type_id=1598c70c-9bfa-4c80-8b76-ca79851e17eb)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Creating volume f4212d8e-cde0-4ac6-b711-5492bd073d49 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:53:59 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:53:59 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 1073741824 Jul 22 20:53:59 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (9ab9ddb8-c070-4111-bb36-6fe46d9e0c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1848fe15-f8d0-4f8c-ab62-9e718e6ef4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3a20e42b-9d11-4bf2-ab81-56d8d94f7cf0 tempest-VolumeDependencyTests-2090401825 None] Create snapshot completed successfully Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1848fe15-f8d0-4f8c-ab62-9e718e6ef4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-195006306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983b82fa-050d-4143-b1fe-5221014bdbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:00Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be6a33b-3174-4ba4-9574-f932d2e7ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be6a33b-3174-4ba4-9574-f932d2e7ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568c0df6-2a9f-4b36-a2c4-7178250f719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568c0df6-2a9f-4b36-a2c4-7178250f719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983b82fa-050d-4143-b1fe-5221014bdbcf', 'volume_name': 'volume-983b82fa-050d-4143-b1fe-5221014bdbcf', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339eebe7-5daa-45a5-8bf8-91de25a0c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339eebe7-5daa-45a5-8bf8-91de25a0c581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd488e65-f457-48ba-965a-d84f1ba99408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:53:59 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume 983b82fa-050d-4143-b1fe-5221014bdbcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983b82fa-050d-4143-b1fe-5221014bdbcf', 'volume_size': 1} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f221730a-f3f3-4060-9177-c998881793e4" returned: 0 in 0.337s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:53:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-f221730a-f3f3-4060-9177-c998881793e4" released by "delete_volume" :: held 0.852s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Created reservations ['0bb15c36-25e7-4152-9e35-a7b59aafd488', '9da47d32-bdc5-46f1-a298-d51ca303601d', '3aacab06-ec1d-4a1e-a518-5568e42713c6', '0379548b-46ca-4ede-b10d-d0e059e5145f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:00 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:00 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:00 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 1073741824" returned: 0 in 0.448s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:00 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 Jul 22 20:54:00 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:00 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:00 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Deleted volume successfully. Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b8647b4b-1f1a-4ec0-af35-adbac37654ab tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-f221730a-f3f3-4060-9177-c998881793e4-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:00 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49" returned: 0 in 0.272s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.405s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222218442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a69c7e7-cd34-4af5-aca8-04cf15477a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:58Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Creating volume 2a69c7e7-cd34-4af5-aca8-04cf15477a91 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:00 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:00 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 1073741824 Jul 22 20:54:00 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Attempting download of 94a640c8-ceb6-44de-a4de-e2bfa90bb317 ((None, [{'url': 'file:///opt/stack/data/glance/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'metadata': {}}])) to volume f4212d8e-cde0-4ac6-b711-5492bd073d49. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd889ec-2852-42f2-95a5-5d84a45af57c]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94a640c8-ceb6-44de-a4de-e2bfa90bb317_oy9pdof5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:00 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94a640c8-ceb6-44de-a4de-e2bfa90bb317_oy9pdof5 Jul 22 20:54:00 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Flow 'volume_create_manager' (57f3fa87-4aca-4542-9ff2-726cc9597a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc4651c-5b00-4be6-b1f7-dea076cfa8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:01 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94a640c8-ceb6-44de-a4de-e2bfa90bb317_oy9pdof5" returned: 0 in 0.427s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94a640c8-ceb6-44de-a4de-e2bfa90bb317_oy9pdof5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc4651c-5b00-4be6-b1f7-dea076cfa8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-237308976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15a754b-ec4d-4342-8f36-aa2e89d6934a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dafcdfb6616e43e2a6a0fed4e09d10f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c159a01-d0a7-44af-96d7-150da0ec9411,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:01Z,use_quota=True,user_id='723d4ba0f3fa44ecb9edf535fc2d808d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75727798-db71-479c-a437-3851d42dcbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75727798-db71-479c-a437-3851d42dcbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa03ff5-0bdc-4b37-a2cd-3adcae21f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa03ff5-0bdc-4b37-a2cd-3adcae21f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f15a754b-ec4d-4342-8f36-aa2e89d6934a', 'volume_name': 'volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a', 'volume_size': 1, 'snapshot_id': '4c159a01-d0a7-44af-96d7-150da0ec9411'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217abd8f-ba02-4d47-a2f7-95d9b4d01359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:01 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217abd8f-ba02-4d47-a2f7-95d9b4d01359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4d0b89-00ca-401c-bcf1-9326741116d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:01 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Volume f15a754b-ec4d-4342-8f36-aa2e89d6934a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a', 'volume_size': 1, 'snapshot_id': '4c159a01-d0a7-44af-96d7-150da0ec9411'} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-403b1881-c674-4817-960e-bbfcc66202b1-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 1073741824" returned: 0 in 0.613s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-403b1881-c674-4817-960e-bbfcc66202b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:01 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94a640c8-ceb6-44de-a4de-e2bfa90bb317_oy9pdof5 Jul 22 20:54:01 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-quobyte-403b1881-c674-4817-960e-bbfcc66202b1" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:01 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 Jul 22 20:54:01 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-403b1881-c674-4817-960e-bbfcc66202b1" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aa7e81-870b-432e-a21a-517e046cbcaa]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:01 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 Jul 22 20:54:01 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:01 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94a640c8-ceb6-44de-a4de-e2bfa90bb317_oy9pdof5" returned: 1 in 0.378s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94a640c8-ceb6-44de-a4de-e2bfa90bb317_oy9pdof5' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[739b1a83-38bf-40c8-9e30-8226e0d41446]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:01 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91" returned: 0 in 0.268s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.971s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609817623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110511a2-12a5-4ca7-9771-4a3935e836d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:58Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Creating volume 110511a2-12a5-4ca7-9771-4a3935e836d8 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:01 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5205d648-081c-4601-ad26-f6d1c629af8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:01 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 1073741824 Jul 22 20:54:01 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4c7137-90d8-42d1-902e-83359b3de6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:01 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 (2a69c7e7-cd34-4af5-aca8-04cf15477a91): created successfully Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4c7137-90d8-42d1-902e-83359b3de6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (2631621c-8cec-4d7c-8f85-beee353f8268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:01 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-61f08745-cfe0-4731-bb7d-a774dbc1c15d tempest-CreateVolumesFromSnapshotTest-315546512 None] Created volume successfully. Jul 22 20:54:01 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD Jul 22 20:54:01 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:01 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1" returned: 0 in 0.404s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:01 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1 Jul 22 20:54:01 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:01 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:01 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-403b1881-c674-4817-960e-bbfcc66202b1" returned: 0 in 0.309s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-403b1881-c674-4817-960e-bbfcc66202b1" released by "delete_volume" :: held 0.756s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:02 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 1073741824" returned: 0 in 0.551s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:02 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD Jul 22 20:54:02 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Created reservations ['6459ebe7-18cd-44ad-9cca-9e60b49167dc', '23d285b9-d43d-444c-abe0-c197ece5cf35', '251d04dd-fccd-416c-a1c6-887fff2ac5e4', '8cb61d1a-3395-4ad5-bcb1-b40c0868d069'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:02 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 Jul 22 20:54:02 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:02 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:02 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:02 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] 94a640c8-ceb6-44de-a4de-e2bfa90bb317 was raw, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-817f67e0-1cf8-400d-87cd-2a6d0ac9c408-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-817f67e0-1cf8-400d-87cd-2a6d0ac9c408-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:02 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 Jul 22 20:54:02 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "cinder-quobyte-817f67e0-1cf8-400d-87cd-2a6d0ac9c408" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-817f67e0-1cf8-400d-87cd-2a6d0ac9c408" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:02 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8" returned: 0 in 0.328s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021558468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdb68ed-fae3-454a-bc04-563a64130e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:59Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Creating volume 9cdb68ed-fae3-454a-bc04-563a64130e5b {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:02 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:02 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22dcc53-dcef-425c-afe9-097ed58748e7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:02 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b 1073741824 Jul 22 20:54:02 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cf62d9-cdf8-4e9f-bab1-cf5969fd67a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110511a2-12a5-4ca7-9771-4a3935e836d8', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5c5c34-8b5d-40c9-a536-732b976b9683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.320s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:02 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Deleted volume successfully. Jul 22 20:54:02 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume volume-110511a2-12a5-4ca7-9771-4a3935e836d8 (110511a2-12a5-4ca7-9771-4a3935e836d8): created successfully Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5c5c34-8b5d-40c9-a536-732b976b9683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (b5733648-664d-49ca-8c53-6cf91121ac76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b46ad9ab-f99b-4b60-9b78-79ac626c4450 tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-403b1881-c674-4817-960e-bbfcc66202b1-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:02 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f3182ad0-f905-4242-a6fc-566966a9cb3d tempest-CreateVolumesFromSnapshotTest-315546512 None] Created volume successfully. Jul 22 20:54:02 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 Jul 22 20:54:02 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:02 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49" returned: 0 in 0.541s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94a640c8-ceb6-44de-a4de-e2bfa90bb317_9v34z5nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:54:02 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:02 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 1G Jul 22 20:54:02 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:02 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408" returned: 0 in 0.432s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:02 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408 Jul 22 20:54:02 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:03 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b 1073741824" returned: 0 in 0.583s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:03 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b Jul 22 20:54:03 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:03 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-817f67e0-1cf8-400d-87cd-2a6d0ac9c408" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:03 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-quobyte-817f67e0-1cf8-400d-87cd-2a6d0ac9c408" released by "delete_volume" :: held 0.792s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 1G" returned: 0 in 0.370s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Downloaded image 94a640c8-ceb6-44de-a4de-e2bfa90bb317 ((None, [{'url': 'file:///opt/stack/data/glance/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'metadata': {}}])) to volume f4212d8e-cde0-4ac6-b711-5492bd073d49 successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Temporary image 94a640c8-ceb6-44de-a4de-e2bfa90bb317 for user 5c77c20ec7754694bd50823bea630e7a is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Marking volume f4212d8e-cde0-4ac6-b711-5492bd073d49 as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Copying metadata from image 94a640c8-ceb6-44de-a4de-e2bfa90bb317 to f4212d8e-cde0-4ac6-b711-5492bd073d49. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Creating volume glance metadata for volume f4212d8e-cde0-4ac6-b711-5492bd073d49 backed by image 94a640c8-ceb6-44de-a4de-e2bfa90bb317 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '175fe54aaef68391d351c236464b8d89', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Created reservations ['a3dbab7b-efb8-48f6-b715-9c4c75ae1d24', '26341eaa-ef6f-4d20-8efd-6a7200a06373', '6e070af5-16bc-4037-86a5-62d526f4daa7', 'ecd88bed-feeb-4c8b-8eeb-b7d65fd67e86'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe38866a-5b20-41ff-a0e1-ca9c45802081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4212d8e-cde0-4ac6-b711-5492bd073d49', 'volume_size': 1, 'image_id': '94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '175fe54aaef68391d351c236464b8d89', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '947d115dcaa14323960bb25164ba165e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '584122cc37a05872b3cdd11bdde14a99e485d8a2369a8dc338a233d32eb56c31474d98362e4a45bc768884e18f0eaddaf446cb41a1244bbdad3e6dd97f473908', 'id': '94a640c8-ceb6-44de-a4de-e2bfa90bb317', 'created_at': datetime.datetime(2026, 7, 22, 18, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 53, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94a640c8-ceb6-44de-a4de-e2bfa90bb317/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35be0a3-bce1-49e9-8c64-c4e28c715f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:03 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Volume volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 (f4212d8e-cde0-4ac6-b711-5492bd073d49): created successfully Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35be0a3-bce1-49e9-8c64-c4e28c715f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:03 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Flow 'volume_create_manager' (4ca30c77-fc08-4e25-b664-c7c4dd74f161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b" returned: 0 in 0.298s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.913s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1842383754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853e6125-12eb-4ef8-afbc-6f9134d72832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:53:59Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Creating volume 853e6125-12eb-4ef8-afbc-6f9134d72832 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:03 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:03 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6be28cb0-92ff-469e-b8bc-3076b33dbcd3 tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Created volume successfully. Jul 22 20:54:03 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 1073741824 Jul 22 20:54:03 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3743c9b7-a1c0-49a8-8800-d76e2a1151fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cdb68ed-fae3-454a-bc04-563a64130e5b', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd4e7a0-4341-4d48-ab1d-340a5156f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:03 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume volume-9cdb68ed-fae3-454a-bc04-563a64130e5b (9cdb68ed-fae3-454a-bc04-563a64130e5b): created successfully Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd4e7a0-4341-4d48-ab1d-340a5156f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (13baff23-8b24-4d5c-a034-2de4660db102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:03 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:03 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:03 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6eb6c552-89ac-4b2b-8ba5-e28a768b2f36 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created volume successfully. Jul 22 20:54:03 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:03 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Deleted volume successfully. Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0ff4a734-a33e-47b2-a165-ef641adb070d tempest-CreateVolumesFromImageTest-564865564 None] Lock "cinder-817f67e0-1cf8-400d-87cd-2a6d0ac9c408-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:03 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 1073741824" returned: 0 in 0.503s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:03 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 Jul 22 20:54:03 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Acquiring lock "cinder-f4212d8e-cde0-4ac6-b711-5492bd073d49-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "cinder-f4212d8e-cde0-4ac6-b711-5492bd073d49-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Acquiring lock "cinder-quobyte-f4212d8e-cde0-4ac6-b711-5492bd073d49" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "cinder-quobyte-f4212d8e-cde0-4ac6-b711-5492bd073d49" acquired by "delete_volume" :: waited 0.023s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8124fd-c64a-42e5-a440-0c0d1610bed6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:04 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832" returned: 0 in 0.340s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.361s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-195006306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983b82fa-050d-4143-b1fe-5221014bdbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e185705e844b838e7ab8129291c18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:00Z,use_quota=True,user_id='e6d68962792745c0bb78707fcd634d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Creating volume 983b82fa-050d-4143-b1fe-5221014bdbcf {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:04 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11eddaa1-8e6f-4e67-b38f-2c45a7ce5e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853e6125-12eb-4ef8-afbc-6f9134d72832', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:04 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf 1073741824 Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8f61ab-7377-4f7e-8747-f5681a2b8539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:04 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:04 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume volume-853e6125-12eb-4ef8-afbc-6f9134d72832 (853e6125-12eb-4ef8-afbc-6f9134d72832): created successfully Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8f61ab-7377-4f7e-8747-f5681a2b8539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (9dcf7fcf-90ff-461e-aedb-ffc693d7501c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:04 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-27bba7fe-8a17-4c4a-82d4-5acae236e3b9 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created volume successfully. Jul 22 20:54:04 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 Jul 22 20:54:04 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:04 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49" returned: 0 in 0.471s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:04 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49 Jul 22 20:54:04 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:04 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf 1073741824" returned: 0 in 0.510s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:04 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf Jul 22 20:54:04 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:05 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f4212d8e-cde0-4ac6-b711-5492bd073d49" returned: 0 in 0.295s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "cinder-quobyte-f4212d8e-cde0-4ac6-b711-5492bd073d49" released by "delete_volume" :: held 0.829s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Created reservations ['dd68bcaf-b9b5-41fd-9ed0-8ef7a485ce7d', '50702e8a-f132-43a0-b383-164f99fc8183', 'f446e2e1-4a55-4b3e-a672-92a8d96cab01', '1b6071b8-4278-406e-a78b-bb5db951d065'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:05 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf" returned: 0 in 0.273s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.942s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-quobyte-4c159a01-d0a7-44af-96d7-150da0ec9411-f15a754b-ec4d-4342-8f36-aa2e89d6934a" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd488e65-f457-48ba-965a-d84f1ba99408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983b82fa-050d-4143-b1fe-5221014bdbcf', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9fc7fa-62a6-45d0-8a6c-a712cf7e6848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-4c159a01-d0a7-44af-96d7-150da0ec9411-f15a754b-ec4d-4342-8f36-aa2e89d6934a" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Creating volume f15a754b-ec4d-4342-8f36-aa2e89d6934a from snapshot 4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-quobyte-f15a754b-ec4d-4342-8f36-aa2e89d6934a" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Volume volume-983b82fa-050d-4143-b1fe-5221014bdbcf (983b82fa-050d-4143-b1fe-5221014bdbcf): created successfully Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9fc7fa-62a6-45d0-8a6c-a712cf7e6848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Flow 'volume_create_manager' (9ab9ddb8-c070-4111-bb36-6fe46d9e0c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-f15a754b-ec4d-4342-8f36-aa2e89d6934a" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] snapshot: 4c159a01-d0a7-44af-96d7-150da0ec9411, volume: f15a754b-ec4d-4342-8f36-aa2e89d6934a, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:54:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-daf267e2-6b47-406c-ac26-56eee5be7ad4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created volume successfully. Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:05 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:05 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b38e4f-9b10-4e64-87e3-5b9497a4dfa8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-983b82fa-050d-4143-b1fe-5221014bdbcf-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-983b82fa-050d-4143-b1fe-5221014bdbcf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:05 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 Jul 22 20:54:05 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-983b82fa-050d-4143-b1fe-5221014bdbcf" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-983b82fa-050d-4143-b1fe-5221014bdbcf" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b13e0e7-fc2c-4114-ae56-1ca9e3962505]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:05 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.496s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Deleted volume successfully. Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4444f1c5-b9bf-489c-8fbb-556d42d3252d tempest-VolumeAndVolumeTypeFromImageTest-1829144908 None] Lock "cinder-f4212d8e-cde0-4ac6-b711-5492bd073d49-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:05 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf Jul 22 20:54:05 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:05 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411" returned: 0 in 0.506s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[11134486-037e-4ec2-ad4c-305d35cae9c1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:06 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 Jul 22 20:54:06 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:06 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf" returned: 0 in 0.497s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:06 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf Jul 22 20:54:06 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:06 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3" returned: 0 in 0.513s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:06 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a Jul 22 20:54:06 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:06 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-983b82fa-050d-4143-b1fe-5221014bdbcf" returned: 0 in 0.396s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-983b82fa-050d-4143-b1fe-5221014bdbcf" released by "delete_volume" :: held 0.989s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created reservations ['74208323-6231-48e8-8dbe-4a0e7cf07aef', '343163a5-21f5-4fdf-9309-9e2495ce27ad', 'dd464e29-0533-49f9-817a-78f4d9e57368', 'fdc89420-2ac4-428d-8363-b0c1a14b878d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:06 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:06 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:07 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:07 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Deleted volume successfully. Jul 22 20:54:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81499084-7541-4d67-a0a9-84853ecf62a3 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-983b82fa-050d-4143-b1fe-5221014bdbcf-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-853e6125-12eb-4ef8-afbc-6f9134d72832-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-853e6125-12eb-4ef8-afbc-6f9134d72832-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-853e6125-12eb-4ef8-afbc-6f9134d72832" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-853e6125-12eb-4ef8-afbc-6f9134d72832" acquired by "delete_volume" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b57f543-b702-485b-a448-f2dd16b9a500]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:08 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 Jul 22 20:54:08 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:09 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832" returned: 0 in 1.138s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:09 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832 Jul 22 20:54:09 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:10 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-853e6125-12eb-4ef8-afbc-6f9134d72832" returned: 0 in 0.648s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-853e6125-12eb-4ef8-afbc-6f9134d72832" released by "delete_volume" :: held 1.877s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created reservations ['246b44a8-4d98-4e3d-8cc2-3bf055c11124', 'c5d01943-a87c-4607-9e7b-2e73c22faa9b', '6af67a06-226c-48b2-a16c-c23cf1b6b58a', 'a975d66e-3450-4579-a416-a26c742092ea'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:10 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:10 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-9cdb68ed-fae3-454a-bc04-563a64130e5b-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-9cdb68ed-fae3-454a-bc04-563a64130e5b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (03c58fb9-d786-4bbc-94f4-676f763ab423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2582cef7-e6fa-4499-98ae-dfde566d8212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2582cef7-e6fa-4499-98ae-dfde566d8212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169249939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9298c323-d214-40e9-bdc9-36a212b69e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:10Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c8cbd9-cea6-409b-bca9-8b26fd634c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c8cbd9-cea6-409b-bca9-8b26fd634c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c240f1-b9f7-4d9d-a68a-a6f9218a7d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c240f1-b9f7-4d9d-a68a-a6f9218a7d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9298c323-d214-40e9-bdc9-36a212b69e64', 'volume_name': 'volume-9298c323-d214-40e9-bdc9-36a212b69e64', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c08419-cd82-46e1-8e54-be92ae122ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c08419-cd82-46e1-8e54-be92ae122ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f160c5-912c-4649-a87b-925e6065bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Volume 9298c323-d214-40e9-bdc9-36a212b69e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9298c323-d214-40e9-bdc9-36a212b69e64', 'volume_size': 1} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-9cdb68ed-fae3-454a-bc04-563a64130e5b" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-9cdb68ed-fae3-454a-bc04-563a64130e5b" acquired by "delete_volume" :: waited 0.057s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfaa6b-b041-46d5-9948-4ec0d6bbcda9]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:11 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.813s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:11 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Deleted volume successfully. Jul 22 20:54:11 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b Jul 22 20:54:11 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-16b79790-6fe9-43d8-963b-8633e546aae4 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-853e6125-12eb-4ef8-afbc-6f9134d72832-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:11 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b" returned: 0 in 0.934s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:11 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b Jul 22 20:54:11 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:12 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9cdb68ed-fae3-454a-bc04-563a64130e5b" returned: 0 in 0.533s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-9cdb68ed-fae3-454a-bc04-563a64130e5b" released by "delete_volume" :: held 1.582s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Created reservations ['59d70d38-2179-4b1e-8f2c-277cb9089a3b', '3bdea3ef-0fa7-42cd-b93b-0d86c1ffcc32', 'd7bab48e-0d04-4374-a634-9d44ee5495bb', 'daf5926d-e0db-4540-bece-fe54e4e0dd14'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:12 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:12 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:12 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a" returned: 0 in 6.335s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51ae1d4-8f7f-4274-a61a-5e6e74c672ce]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:12 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 Jul 22 20:54:12 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-110511a2-12a5-4ca7-9771-4a3935e836d8-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-110511a2-12a5-4ca7-9771-4a3935e836d8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:13 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.290s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Deleted volume successfully. Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-110511a2-12a5-4ca7-9771-4a3935e836d8" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1f1aade2-5edf-4b1b-abab-10372fd7f7ff tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-9cdb68ed-fae3-454a-bc04-563a64130e5b-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-110511a2-12a5-4ca7-9771-4a3935e836d8" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f54c3-e448-4d42-b1fc-a43601f5f424]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:13 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 Jul 22 20:54:13 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:13 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3" returned: 0 in 0.632s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:54:13 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Converted 1024.00 MB image at 161.60 MB/s Jul 22 20:54:13 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a is being set with open permissions: ugo+rw Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:13 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a Jul 22 20:54:13 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:13 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:13 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8 Jul 22 20:54:13 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:13 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-f15a754b-ec4d-4342-8f36-aa2e89d6934a" released by "_copy_volume_from_snapshot" :: held 8.485s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-4c159a01-d0a7-44af-96d7-150da0ec9411-f15a754b-ec4d-4342-8f36-aa2e89d6934a" released by "_create_volume_from_snapshot" :: held 8.547s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.588s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.023s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169249939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9298c323-d214-40e9-bdc9-36a212b69e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:10Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Creating volume 9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:13 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:13 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 1073741824 Jul 22 20:54:13 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:13 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-110511a2-12a5-4ca7-9771-4a3935e836d8" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4d0b89-00ca-401c-bcf1-9326741116d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a', 'volume_size': 1, 'snapshot_id': '4c159a01-d0a7-44af-96d7-150da0ec9411'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07268fba-62d8-47a4-a1e2-680c21fcc0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-110511a2-12a5-4ca7-9771-4a3935e836d8" released by "delete_volume" :: held 0.733s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Volume volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a (f15a754b-ec4d-4342-8f36-aa2e89d6934a): created successfully Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07268fba-62d8-47a4-a1e2-680c21fcc0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Flow 'volume_create_manager' (57f3fa87-4aca-4542-9ff2-726cc9597a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-56fffc21-1763-4abd-bf3d-9cfb1353b7d7 tempest-VolumeDependencyTests-2090401825 None] Created volume successfully. Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created reservations ['cd5c033d-f627-4d8f-aa31-29330cfc1a16', '527f0894-7ba9-40d2-a2c6-954deba4b2f4', '895cbf64-9b5b-4523-ae40-719dec1c1509', '02471f79-c0b8-4eb1-b4a9-88df074eb3f9'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:14 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:14 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-2a69c7e7-cd34-4af5-aca8-04cf15477a91-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-2a69c7e7-cd34-4af5-aca8-04cf15477a91-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:14 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-2a69c7e7-cd34-4af5-aca8-04cf15477a91" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.319s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Deleted volume successfully. Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-2a69c7e7-cd34-4af5-aca8-04cf15477a91" acquired by "delete_volume" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:14 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 1073741824" returned: 0 in 0.614s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b91075-58f0-470f-b52f-c5a99020d35f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-22397be8-f09d-4972-aa02-12beec3a5046 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-110511a2-12a5-4ca7-9771-4a3935e836d8-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-4c159a01-d0a7-44af-96d7-150da0ec9411-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-4c159a01-d0a7-44af-96d7-150da0ec9411-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-quobyte-7018d877-7c38-45dc-81b0-f1a59cfc31a3" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-7018d877-7c38-45dc-81b0-f1a59cfc31a3" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-quobyte-4c159a01-d0a7-44af-96d7-150da0ec9411" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:14 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 Jul 22 20:54:14 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-4c159a01-d0a7-44af-96d7-150da0ec9411" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:14 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 Jul 22 20:54:14 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Deleting offline snapshot 4c159a01-d0a7-44af-96d7-150da0ec9411 of volume 7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] snapshot_file for this snap is: volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f33e76-1ee1-4e36-b4b8-4c5b627e115a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (f3eabf95-e720-4f19-b166-565467350352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b3f31d-cdd9-40ec-b5f4-5f311cfa067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b3f31d-cdd9-40ec-b5f4-5f311cfa067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-29614756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca85a298-1894-4fec-a03e-ba429c3c05bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:15Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200d2805-6229-4bb9-91fe-173b7ca0b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:14 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 Jul 22 20:54:14 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200d2805-6229-4bb9-91fe-173b7ca0b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c92c587-a167-445b-89af-77b17d28757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c92c587-a167-445b-89af-77b17d28757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca85a298-1894-4fec-a03e-ba429c3c05bd', 'volume_name': 'volume-ca85a298-1894-4fec-a03e-ba429c3c05bd', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fe7aa4-9270-475d-9573-ea74eb7a027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fe7aa4-9270-475d-9573-ea74eb7a027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708b3de8-9317-492f-b470-9816dbfb749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume ca85a298-1894-4fec-a03e-ba429c3c05bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca85a298-1894-4fec-a03e-ba429c3c05bd', 'volume_size': 1} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:14 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64" returned: 0 in 0.390s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:14 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.092s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-29614756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca85a298-1894-4fec-a03e-ba429c3c05bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:15Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Creating volume ca85a298-1894-4fec-a03e-ba429c3c05bd {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:14 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91" returned: 0 in 0.537s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:14 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd 1073741824 Jul 22 20:54:14 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f160c5-912c-4649-a87b-925e6065bd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9298c323-d214-40e9-bdc9-36a212b69e64', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:14 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91 Jul 22 20:54:14 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fa7b03-e3b3-470e-9c8b-78a247c1cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Volume volume-9298c323-d214-40e9-bdc9-36a212b69e64 (9298c323-d214-40e9-bdc9-36a212b69e64): created successfully Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fa7b03-e3b3-470e-9c8b-78a247c1cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (03c58fb9-d786-4bbc-94f4-676f763ab423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-53e33efa-5169-4e09-bb04-547a44f84831 tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:54:15 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411" returned: 0 in 0.454s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7abb242-3269-4449-89d2-1e48a4104e01]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:15 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 Jul 22 20:54:15 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:15 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-2a69c7e7-cd34-4af5-aca8-04cf15477a91" returned: 0 in 0.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-2a69c7e7-cd34-4af5-aca8-04cf15477a91" released by "delete_volume" :: held 0.893s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created reservations ['9e78ec70-86cb-45a4-a0a0-e1b9273e26ea', '156f1352-a44f-4169-bbf5-d7605b8f856b', '90bfa002-c337-4dc9-96a0-b44c8a8b059f', '98ada1ff-34f3-479a-8145-2a6f85afadf4'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:15 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:15 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:15 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd 1073741824" returned: 0 in 0.527s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-ae830d5c-0e8c-4a05-aa1a-55250c4c8545-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-ae830d5c-0e8c-4a05-aa1a-55250c4c8545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-ae830d5c-0e8c-4a05-aa1a-55250c4c8545" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:15 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd Jul 22 20:54:15 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-ae830d5c-0e8c-4a05-aa1a-55250c4c8545" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:15 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Deleting offline snapshot ae830d5c-0e8c-4a05-aa1a-55250c4c8545 of volume ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] snapshot_file for this snap is: volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3" returned: 0 in 0.532s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cda3e3-c9f9-4ac0-8467-a06a06e9ce74]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:15 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 Jul 22 20:54:15 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:15 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 Jul 22 20:54:15 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:15 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.419s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Deleted volume successfully. Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-26126d25-023f-4b89-a77f-b45d2bc4c060 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-2a69c7e7-cd34-4af5-aca8-04cf15477a91-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:15 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd" returned: 0 in 0.372s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708b3de8-9317-492f-b470-9816dbfb749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca85a298-1894-4fec-a03e-ba429c3c05bd', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69139566-bcc4-4809-9a3c-da78e950524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:15 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume volume-ca85a298-1894-4fec-a03e-ba429c3c05bd (ca85a298-1894-4fec-a03e-ba429c3c05bd): created successfully Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69139566-bcc4-4809-9a3c-da78e950524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (f3eabf95-e720-4f19-b166-565467350352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:15 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c3e0bf42-0cf2-4e2e-be1e-c1755501b67c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created volume successfully. Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:16 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot 726403bb-9572-4cd5-b44a-ab35ef866fc3 of volume 9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545" returned: 0 in 0.453s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:16 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b0d452-ac35-4240-892e-343fccee5b42]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[671d6f75-d215-454d-a058-d4bcfaa5f250]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411" returned: 0 in 0.519s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:16 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411 Jul 22 20:54:16 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:16 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 Jul 22 20:54:16 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:16 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 Jul 22 20:54:16 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:16 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3.4c159a01-d0a7-44af-96d7-150da0ec9411" returned: 0 in 0.268s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-4c159a01-d0a7-44af-96d7-150da0ec9411" released by "_delete_snapshot" :: held 1.899s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-7018d877-7c38-45dc-81b0-f1a59cfc31a3" released by "delete_snapshot" :: held 1.945s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:16 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64" returned: 0 in 0.376s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:16 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" returned: 0 in 0.384s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:16 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 1G Jul 22 20:54:16 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:16 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 Jul 22 20:54:16 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Created reservations ['2b7709f0-287a-43ec-a06d-f615f3281cb2', 'cba95225-37bc-45b5-ba9c-d78be84c6b9d', 'c9f882f8-8983-4737-b95a-15d26a9b63c8', '53cc4d42-fbf3-458c-b0dd-b25558cc4436'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Delete snapshot completed successfully. Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3af89960-8bca-4a50-96cf-47d8bbb70b31 tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-4c159a01-d0a7-44af-96d7-150da0ec9411-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:16 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545" returned: 0 in 0.391s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:16 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 1G" returned: 0 in 0.431s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9298c323-d214-40e9-bdc9-36a212b69e64 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:16 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545 Jul 22 20:54:16 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:16 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9298c323-d214-40e9-bdc9-36a212b69e64 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 Jul 22 20:54:16 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:17 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07.ae830d5c-0e8c-4a05-aa1a-55250c4c8545" returned: 0 in 0.330s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:17 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (2413d180-4ad4-44cc-8dbc-4867dc266ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6bdaa2-ca92-4a54-80f1-2d81561353d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-ae830d5c-0e8c-4a05-aa1a-55250c4c8545" released by "_delete_snapshot" :: held 1.733s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9298c323-d214-40e9-bdc9-36a212b69e64 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3" returned: 0 in 0.394s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:17 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 is being set with open permissions: ugo+rw Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" released by "delete_snapshot" :: held 1.808s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:17 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 Jul 22 20:54:17 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6bdaa2-ca92-4a54-80f1-2d81561353d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762710365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:17Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffcf6b-8ae9-49dc-aa1c-34c8d39b76da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffcf6b-8ae9-49dc-aa1c-34c8d39b76da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff700a1-7337-4b47-9f78-65d2a2360dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff700a1-7337-4b47-9f78-65d2a2360dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d', 'volume_name': 'volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93afce1a-5c59-4115-8e3c-ff537fb7f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93afce1a-5c59-4115-8e3c-ff537fb7f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058b3a6c-9ef0-4f9d-bde4-e68e25d521a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume 63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d', 'volume_size': 1} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Created reservations ['5ac9b113-be63-4f14-92a0-a0d410920614', '7d064e72-0f74-40d4-b739-5480323c5f3d', 'ffd39407-dfba-48bd-806e-c6105e5d2e7b', '7b6627d4-f7ac-43b3-80aa-64bb9ac320ea'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Delete snapshot completed successfully. Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e0c73ab8-8d39-4869-bd8a-adae5d18da99 tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-ae830d5c-0e8c-4a05-aa1a-55250c4c8545-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:17 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3" returned: 0 in 0.284s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-ecc00fb4-c639-47ea-8d26-4daa2fb93d07-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:17 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.info Jul 22 20:54:17 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (efa0dd2f-c0f6-4eb1-bd6d-aa9cd18ba004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32cc1fd-5db4-47a7-8e7f-524213c46def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32cc1fd-5db4-47a7-8e7f-524213c46def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821226481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ae3142-bb49-47aa-9e87-9c2fcc1604f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:18Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f495466-b7b0-49f0-96dd-c2823a7d2907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f495466-b7b0-49f0-96dd-c2823a7d2907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71d6169-6ded-4a29-bbf0-92679594e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71d6169-6ded-4a29-bbf0-92679594e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ae3142-bb49-47aa-9e87-9c2fcc1604f1', 'volume_name': 'volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc82542c-9e9d-406a-a16f-16ce64b412e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc82542c-9e9d-406a-a16f-16ce64b412e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f47181-e1fd-4844-abbe-26a607115d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:17 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume d4ae3142-bb49-47aa-9e87-9c2fcc1604f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1', 'volume_size': 1} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-ecc00fb4-c639-47ea-8d26-4daa2fb93d07-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-7018d877-7c38-45dc-81b0-f1a59cfc31a3-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-7018d877-7c38-45dc-81b0-f1a59cfc31a3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "cinder-quobyte-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-quobyte-7018d877-7c38-45dc-81b0-f1a59cfc31a3" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-7018d877-7c38-45dc-81b0-f1a59cfc31a3" acquired by "delete_volume" :: waited 0.072s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:18 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff8727-6e94-4da8-a5fd-368bfa7b728b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.info" returned: 0 in 0.414s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:18 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.info is being set with open permissions: ugo+rw Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b4c4f6-4a38-4b58-a85c-44addf29e248]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:18 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.info Jul 22 20:54:18 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (2792d07c-882a-470b-a886-9c1e0914c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4d182d-52e9-4975-ad2e-a512047a44f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 Jul 22 20:54:18 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4d182d-52e9-4975-ad2e-a512047a44f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998213408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:18Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72404b91-5fcf-4c71-a6a8-dd50f5acd0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72404b91-5fcf-4c71-a6a8-dd50f5acd0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85153fb-78ca-4631-943d-1f2df4ae9aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85153fb-78ca-4631-943d-1f2df4ae9aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97', 'volume_name': 'volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a406e0-8055-459d-b6d7-8dc1839df222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a406e0-8055-459d-b6d7-8dc1839df222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f499062-e8d3-4a4d-81ce-85a26d895762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97', 'volume_size': 1} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:18 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 Jul 22 20:54:18 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:18 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" returned: 0 in 0.439s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:18 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.info" returned: 0 in 0.441s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:18 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07 Jul 22 20:54:18 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762710365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:17Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Creating volume 63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:18 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:18 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d 1073741824 Jul 22 20:54:18 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:18 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3" returned: 0 in 0.600s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2b4e178b-3b2d-47a7-8620-8ce3808e9d73 tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:18 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3 Jul 22 20:54:18 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (fe052928-e6f4-4f38-843a-98c49ae25386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe790d5-d4ab-4608-af54-f9be88f90c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe790d5-d4ab-4608-af54-f9be88f90c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2079355333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:19Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd53701-652e-4956-b172-89a63973c49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd53701-652e-4956-b172-89a63973c49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad8a386-0e91-428b-b03a-5821f9143ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad8a386-0e91-428b-b03a-5821f9143ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4', 'volume_name': 'volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc98d4ee-ffed-4e86-b8c5-10d904892c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc98d4ee-ffed-4e86-b8c5-10d904892c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c165c6-321f-4320-a33e-fa28bdbba0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:18 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4', 'volume_size': 1} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" returned: 0 in 0.404s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-quobyte-ecc00fb4-c639-47ea-8d26-4daa2fb93d07" released by "delete_volume" :: held 0.996s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Created reservations ['1dd9cb80-6942-4f55-be6d-68b7001a8a1c', 'bee43cad-24e5-4dd6-84f9-41218b2972cf', 'b710857b-16a4-47b5-bfaa-c1d3bd34147e', 'ace53f2f-0be9-4c51-b88c-959758d086ff'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:19 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-7018d877-7c38-45dc-81b0-f1a59cfc31a3" returned: 0 in 0.372s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-7018d877-7c38-45dc-81b0-f1a59cfc31a3" released by "delete_volume" :: held 1.102s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:19 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:19 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (90a71db6-6d8d-417d-89b8-43a8471de935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:19 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a109c372-a1db-4dbf-86a8-a2028a1a18ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-726403bb-9572-4cd5-b44a-ab35ef866fc3-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Created reservations ['966bdd7f-dd21-43cb-8032-0b83ee3795c5', '64118ae1-abe0-46f3-9aaf-bee472d6d12b', 'e98e5753-1f38-4fa0-afe5-0f6cb05a888b', '1dfc627b-5ba5-4388-878b-ea60c52e38a8'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d 1073741824" returned: 0 in 0.682s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a109c372-a1db-4dbf-86a8-a2028a1a18ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1724288367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6406e942-6cb7-4302-bb80-50478a1e6e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:19Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3b4049-dfc0-4819-b8dd-7b4d8f08008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3b4049-dfc0-4819-b8dd-7b4d8f08008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24e9af5-ce83-4ea6-b933-c23655b6b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24e9af5-ce83-4ea6-b933-c23655b6b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6406e942-6cb7-4302-bb80-50478a1e6e83', 'volume_name': 'volume-6406e942-6cb7-4302-bb80-50478a1e6e83', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1eb8d4-a533-4c28-b75b-92767173a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1eb8d4-a533-4c28-b75b-92767173a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84da7e3-d961-46ea-bef2-343ac7255287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:19 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume 6406e942-6cb7-4302-bb80-50478a1e6e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6406e942-6cb7-4302-bb80-50478a1e6e83', 'volume_size': 1} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Lock "cinder-726403bb-9572-4cd5-b44a-ab35ef866fc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-9298c323-d214-40e9-bdc9-36a212b69e64" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-9298c323-d214-40e9-bdc9-36a212b69e64" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-726403bb-9572-4cd5-b44a-ab35ef866fc3" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-726403bb-9572-4cd5-b44a-ab35ef866fc3" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:19 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot 726403bb-9572-4cd5-b44a-ab35ef866fc3 of volume 9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:19 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:19 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c15ad3-6aba-4fb9-80a6-ec503a50d682]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:19 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:19 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.336s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Deleted volume successfully. Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d8ad4886-e62f-4b90-a259-2a63cbdd4f1b tempest-CreateVolumesFromSnapshotTest-315546512 None] Lock "cinder-ecc00fb4-c639-47ea-8d26-4daa2fb93d07-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:19 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 Jul 22 20:54:19 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:19 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.917s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821226481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ae3142-bb49-47aa-9e87-9c2fcc1604f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:18Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Creating volume d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:19 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:19 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.266s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Deleted volume successfully. Jul 22 20:54:19 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 1073741824 Jul 22 20:54:19 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058b3a6c-9ef0-4f9d-bde4-e68e25d521a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467f7fe0-c138-415f-901e-1d4cd1a5125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f0a55c5f-6586-4550-b068-c567e9f0899b tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-7018d877-7c38-45dc-81b0-f1a59cfc31a3-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:19 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d (63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d): created successfully Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467f7fe0-c138-415f-901e-1d4cd1a5125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (2413d180-4ad4-44cc-8dbc-4867dc266ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-213940ad-1509-4ba0-8169-015da9b37b5c tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created volume successfully. Jul 22 20:54:19 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3" returned: 0 in 0.415s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9298c323-d214-40e9-bdc9-36a212b69e64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e875a4-c57b-4d4a-b4d8-8cbf6e40d30c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:20 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 Jul 22 20:54:20 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-f15a754b-ec4d-4342-8f36-aa2e89d6934a-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-f15a754b-ec4d-4342-8f36-aa2e89d6934a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "cinder-quobyte-f15a754b-ec4d-4342-8f36-aa2e89d6934a" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:20 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 1073741824" returned: 0 in 0.584s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-f15a754b-ec4d-4342-8f36-aa2e89d6934a" acquired by "delete_volume" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3bc3e2-7765-4634-a3b9-d1be04f06c04]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:20 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 Jul 22 20:54:20 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:20 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64" returned: 0 in 0.496s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:20 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 Jul 22 20:54:20 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:20 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a Jul 22 20:54:20 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:20 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1" returned: 0 in 0.286s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.396s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998213408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:18Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Creating volume e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:20 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:20 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 1073741824 Jul 22 20:54:20 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:20 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f47181-e1fd-4844-abbe-26a607115d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d1381b-2f29-464e-ad00-cca5f8f66bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a" returned: 0 in 0.412s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:20 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a Jul 22 20:54:20 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 (d4ae3142-bb49-47aa-9e87-9c2fcc1604f1): created successfully Jul 22 20:54:20 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d1381b-2f29-464e-ad00-cca5f8f66bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:20 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (efa0dd2f-c0f6-4eb1-bd6d-aa9cd18ba004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3" returned: 0 in 0.408s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:20 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-64e7ac22-a9a5-43f3-8a2b-995087c6a786 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created volume successfully. Jul 22 20:54:20 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3 Jul 22 20:54:20 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:21 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f15a754b-ec4d-4342-8f36-aa2e89d6934a" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-quobyte-f15a754b-ec4d-4342-8f36-aa2e89d6934a" released by "delete_volume" :: held 0.814s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:21 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64.726403bb-9572-4cd5-b44a-ab35ef866fc3" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Created reservations ['0b664ff3-b52d-4d36-b689-99d9be06146a', '8f6e521c-192a-43de-8ed4-70a169014de7', '950c497a-3eda-45ac-9ec5-c56d2a7bbbcc', 'a3d7a1c9-3166-4d23-a971-a03aaa717be5'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:21 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 1073741824" returned: 0 in 0.583s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-726403bb-9572-4cd5-b44a-ab35ef866fc3" released by "_delete_snapshot" :: held 1.866s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-9298c323-d214-40e9-bdc9-36a212b69e64" released by "delete_snapshot" :: held 1.935s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:21 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:21 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:21 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:21 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Created reservations ['862a08ce-9bae-4e8d-8802-13b7ef26595d', 'a3dc3aff-6bd4-45bb-bbb4-f61da12ac39d', '9e651a3f-94a3-47e1-8a38-0fe350e3038f', '9c5653a4-b4a5-4722-b9d1-b845bba2f202'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-5db2eed7-4fb7-4e70-85d0-1b8aa69053aa tempest-ProjectMemberTests-1773716304 None] Lock "cinder-726403bb-9572-4cd5-b44a-ab35ef866fc3-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:21 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Deleted volume successfully. Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f4f398d0-676a-4722-ba7f-61a45e85506d tempest-VolumeDependencyTests-2090401825 None] Lock "cinder-f15a754b-ec4d-4342-8f36-aa2e89d6934a-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:21 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97" returned: 0 in 0.465s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.947s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2079355333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:19Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Creating volume b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:21 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f499062-e8d3-4a4d-81ce-85a26d895762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf55411-457b-407d-adc3-4b1c099b2bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:21 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 1073741824 Jul 22 20:54:21 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:21 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 (e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97): created successfully Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf55411-457b-407d-adc3-4b1c099b2bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:21 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (2792d07c-882a-470b-a886-9c1e0914c371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c7644a58-e2df-4164-8355-b9ae7e3e4d12 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created volume successfully. Jul 22 20:54:22 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 1073741824" returned: 0 in 0.555s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:22 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 Jul 22 20:54:22 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-9298c323-d214-40e9-bdc9-36a212b69e64-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-9298c323-d214-40e9-bdc9-36a212b69e64-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-9298c323-d214-40e9-bdc9-36a212b69e64" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-9298c323-d214-40e9-bdc9-36a212b69e64" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[45961e31-c781-4e66-a77a-2b6a8df451a0]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:22 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4" returned: 0 in 0.361s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.486s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1724288367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6406e942-6cb7-4302-bb80-50478a1e6e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01ec5f1657a49978aa05526985bc56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:19Z,use_quota=True,user_id='7fe1bdc36b864e569129f8045bae65a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Creating volume 6406e942-6cb7-4302-bb80-50478a1e6e83 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:22 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:22 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 1073741824 Jul 22 20:54:22 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c165c6-321f-4320-a33e-fa28bdbba0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9bf7c5-1402-4845-8c34-69f5d3bd8c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:22 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 Jul 22 20:54:22 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:22 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 (b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4): created successfully Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9bf7c5-1402-4845-8c34-69f5d3bd8c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:22 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (fe052928-e6f4-4f38-843a-98c49ae25386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:22 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-51f1794b-c362-4362-83bb-4ce3316b9aca tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created volume successfully. Jul 22 20:54:23 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64" returned: 0 in 0.502s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:23 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64 Jul 22 20:54:23 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:23 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 1073741824" returned: 0 in 0.565s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:23 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 Jul 22 20:54:23 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:23 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9298c323-d214-40e9-bdc9-36a212b69e64" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-9298c323-d214-40e9-bdc9-36a212b69e64" released by "delete_volume" :: held 0.907s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Created reservations ['40888752-4b01-4c0c-9707-6a09329a0848', '3430d724-8e2e-4393-b93b-cfb060907baf', '8536421e-07b4-4888-907d-3846a3558ea3', '86e04b00-bacf-4529-8b48-7fb16e66b857'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:23 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84da7e3-d961-46ea-bef2-343ac7255287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6406e942-6cb7-4302-bb80-50478a1e6e83', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83389db-67ac-4b34-906b-e34f007483f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:23 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Volume volume-6406e942-6cb7-4302-bb80-50478a1e6e83 (6406e942-6cb7-4302-bb80-50478a1e6e83): created successfully Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83389db-67ac-4b34-906b-e34f007483f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Flow 'volume_create_manager' (90a71db6-6d8d-417d-89b8-43a8471de935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-efa51538-9d79-4a51-bd4f-3f6718d9a502 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created volume successfully. Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:23 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:23 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:24 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.269s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:24 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:24 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:54:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-2ba53372-ef5e-47f9-9009-17586904653a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-9298c323-d214-40e9-bdc9-36a212b69e64-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-6406e942-6cb7-4302-bb80-50478a1e6e83-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-6406e942-6cb7-4302-bb80-50478a1e6e83-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-quobyte-6406e942-6cb7-4302-bb80-50478a1e6e83" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:24 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-6406e942-6cb7-4302-bb80-50478a1e6e83" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a902c235-e63b-4778-82d7-b98c9aa02b3f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:25 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 Jul 22 20:54:25 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Flow 'volume_create_manager' (9d13281f-3956-4870-a32e-a6e98d2ebbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d08dec-2c07-4f93-b4d6-3c09ac636db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d08dec-2c07-4f93-b4d6-3c09ac636db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e264ba-e0d9-49e8-9bbf-76054155dd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f0911ff52e4ffa9d2eafef21e519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:25Z,use_quota=True,user_id='e6f05ff1ce32430fa3d3450de84ae9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5e2324-666e-4679-861f-5bdc1eeb14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5e2324-666e-4679-861f-5bdc1eeb14c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486204ca-2493-4935-8990-acce0ab59577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486204ca-2493-4935-8990-acce0ab59577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e264ba-e0d9-49e8-9bbf-76054155dd14', 'volume_name': 'volume-72e264ba-e0d9-49e8-9bbf-76054155dd14', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0f19f7-2e3f-4161-8346-3947f8f3cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0f19f7-2e3f-4161-8346-3947f8f3cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaf73f9-386e-4558-ac98-974e8173f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Volume 72e264ba-e0d9-49e8-9bbf-76054155dd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e264ba-e0d9-49e8-9bbf-76054155dd14', 'volume_size': 1} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e264ba-e0d9-49e8-9bbf-76054155dd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f0911ff52e4ffa9d2eafef21e519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:25Z,use_quota=True,user_id='e6f05ff1ce32430fa3d3450de84ae9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Creating volume 72e264ba-e0d9-49e8-9bbf-76054155dd14 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:25 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:25 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 1073741824 Jul 22 20:54:25 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:25 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83" returned: 0 in 0.551s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:25 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83 Jul 22 20:54:25 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (b6dc82a9-512e-40b8-8ff7-39122ed0e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2048850-6180-4e73-bb3f-29ca9c5b217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2048850-6180-4e73-bb3f-29ca9c5b217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-117577571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441ef8e9-088a-40fa-b053-ab9324aad674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:26Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f5e53-9125-402c-9cd0-1168d4592058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f5e53-9125-402c-9cd0-1168d4592058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385cc1f6-bb17-4930-a56e-18f145a66686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385cc1f6-bb17-4930-a56e-18f145a66686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441ef8e9-088a-40fa-b053-ab9324aad674', 'volume_name': 'volume-441ef8e9-088a-40fa-b053-ab9324aad674', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b23d696-56ae-495a-87bf-afcabd2f0c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b23d696-56ae-495a-87bf-afcabd2f0c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc3a864-b953-4442-bfef-8ab90350a1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Volume 441ef8e9-088a-40fa-b053-ab9324aad674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441ef8e9-088a-40fa-b053-ab9324aad674', 'volume_size': 1} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:25 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-6406e942-6cb7-4302-bb80-50478a1e6e83" returned: 0 in 0.309s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-6406e942-6cb7-4302-bb80-50478a1e6e83" released by "delete_volume" :: held 0.915s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created reservations ['01e9c199-b6c7-409d-9539-fbfeaee7f1b9', '88793c57-f43a-4470-8c53-08ec13892acf', '17fd2156-8266-48e2-972f-f5c54941855f', '64adec40-c9d6-45c4-9543-f3f79693d7a6'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:25 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 1073741824" returned: 0 in 0.502s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:26 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 Jul 22 20:54:26 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:26 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:26 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-quobyte-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d03bf29-0f0c-4ff0-b6aa-9e9f7d0c4dea]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:26 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14" returned: 0 in 0.323s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-117577571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441ef8e9-088a-40fa-b053-ab9324aad674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:26Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Creating volume 441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:26 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:26 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaf73f9-386e-4558-ac98-974e8173f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e264ba-e0d9-49e8-9bbf-76054155dd14', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:26 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:26 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 1073741824 Jul 22 20:54:26 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3b8c48-fbba-4f49-a01d-f9416f897cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:26 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Volume volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 (72e264ba-e0d9-49e8-9bbf-76054155dd14): created successfully Jul 22 20:54:26 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3b8c48-fbba-4f49-a01d-f9416f897cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Flow 'volume_create_manager' (9d13281f-3956-4870-a32e-a6e98d2ebbc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Deleted volume successfully. Jul 22 20:54:26 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d0dade51-6f54-49b9-9a9f-9c6002277243 tempest-CinderUnicodeTest-1076901128 None] Created volume successfully. Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a367e1e4-9c26-4e78-a361-4f92d8e634a6 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-6406e942-6cb7-4302-bb80-50478a1e6e83-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:26 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4" returned: 0 in 0.510s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:26 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4 Jul 22 20:54:26 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Flow 'volume_create_manager' (3b305f49-a5d9-4f9a-919c-9ca13e86cf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0229d35-37d1-4a03-abbb-735d0422cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0229d35-37d1-4a03-abbb-735d0422cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fa67e9a60048d383fd577ad71ee90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:27Z,use_quota=True,user_id='1789a3b506ef49af954278bb3e378578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4359e6-3036-4988-b157-e83113e873d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4359e6-3036-4988-b157-e83113e873d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc6db7f-4a43-4fed-a2dc-6ba969ecbcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG cinder.image.glance [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Creating Keystone auth plugin from conf {{(pid=87818) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 20:54:26 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 1073741824" returned: 0 in 0.571s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:27 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 Jul 22 20:54:27 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:27 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4" returned: 0 in 0.294s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4" released by "delete_volume" :: held 0.855s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created reservations ['afe6af77-c96d-4303-95c0-f5ca52ba8a9b', '99f5781d-2452-452d-8675-7a6f00bed0f3', 'dd360021-0b06-4b15-97df-c68c6d9d0a2e', '8a2a3d88-c2fa-4592-8ae1-4c8ba57e4bfa'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:27 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:27 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:27 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674" returned: 0 in 0.289s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc3a864-b953-4442-bfef-8ab90350a1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441ef8e9-088a-40fa-b053-ab9324aad674', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40d39a6-e32a-4a2b-b0e5-7b59260020de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:27 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Volume volume-441ef8e9-088a-40fa-b053-ab9324aad674 (441ef8e9-088a-40fa-b053-ab9324aad674): created successfully Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40d39a6-e32a-4a2b-b0e5-7b59260020de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (b6dc82a9-512e-40b8-8ff7-39122ed0e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bfd27137-59a5-4032-9f03-61fec5238155 tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc6db7f-4a43-4fed-a2dc-6ba969ecbcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d', 'volume_name': 'volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d', 'volume_size': 1, 'image_id': '1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4aa461634bdac4027ff1476958ebc2a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01fa67e9a60048d383fd577ad71ee90a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10c5679e186aa98c3e4c22f1d53862a32352c0c9b5b813ed1afe0b75467096dd6808c513fc60e4b6aa11d4462db28facd8c04d947928ae8af181bae0741394a2', 'id': '1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'created_at': datetime.datetime(2026, 7, 22, 18, 54, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 54, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca/file', 'properties': {}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a572f-7c53-4bc2-84fc-d89093517025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a572f-7c53-4bc2-84fc-d89093517025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547b4be0-5a62-4e90-9d08-9f40d64771d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:27 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Volume f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d', 'volume_size': 1, 'image_id': '1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4aa461634bdac4027ff1476958ebc2a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01fa67e9a60048d383fd577ad71ee90a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10c5679e186aa98c3e4c22f1d53862a32352c0c9b5b813ed1afe0b75467096dd6808c513fc60e4b6aa11d4462db28facd8c04d947928ae8af181bae0741394a2', 'id': '1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'created_at': datetime.datetime(2026, 7, 22, 18, 54, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 54, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca/file', 'properties': {}}, 'image_service': } Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Trying to clone f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d from image 1b549891-1ffb-48fa-9e68-1b14e09cfdca at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'metadata': {}}]). {{(pid=87818) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-quobyte-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:27 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97" acquired by "delete_volume" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Deleted volume successfully. Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bffaba9-7f09-4664-b6eb-1ee5bd59d2ac]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 20:54:27 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Image download 0.00 MB at 0.00 MB/s Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f405091c-160e-4f89-bea7-ebf7644cf59b tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-b54b90ed-fdd8-4cc3-a9b1-43738dd21ef4-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f449e0b-8587-4298-8f2b-b15b76f97383]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:27 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 Jul 22 20:54:27 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:27 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD Jul 22 20:54:27 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97" returned: 0 in 0.505s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot b1f6678f-d90a-4c28-b597-cacd92753b6a of volume 441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:54:28 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97 Jul 22 20:54:28 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5782c6-986e-4e11-918b-4fdf4f4c1a09]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:28 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD Jul 22 20:54:28 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 Jul 22 20:54:28 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Flow 'volume_create_manager' (45339c4a-5d6c-4c7d-a775-472d00f573b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e91a62-1c03-4f8d-ac81-3a6890b660eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e91a62-1c03-4f8d-ac81-3a6890b660eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-788856705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a87fc1-d5a6-4ef5-a475-386a0a5cfa95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f0911ff52e4ffa9d2eafef21e519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:28Z,use_quota=True,user_id='e6f05ff1ce32430fa3d3450de84ae9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9363fb0-f3d7-4169-b5d5-ab731f864f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:28 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9363fb0-f3d7-4169-b5d5-ab731f864f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b0df87-5243-4ca1-8389-3e96640cf80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b0df87-5243-4ca1-8389-3e96640cf80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a87fc1-d5a6-4ef5-a475-386a0a5cfa95', 'volume_name': 'volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30f1960-cfe4-4a65-9f44-0519fedc2ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30f1960-cfe4-4a65-9f44-0519fedc2ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9467700a-43ed-4265-a971-944ade536d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Volume 03a87fc1-d5a6-4ef5-a475-386a0a5cfa95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95', 'volume_size': 1} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97" returned: 0 in 0.324s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97" released by "delete_volume" :: held 0.890s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created reservations ['0cf836fa-cb97-4b09-a346-60c2a88934d3', 'cc68e409-66a8-4298-8e28-606c918c975e', '6ee75b8d-90a9-46a9-8d87-e64e6c9dfb40', '7b845a52-5685-47e3-8007-c32f1f8f7290'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:28 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Temporary image 1b549891-1ffb-48fa-9e68-1b14e09cfdca is fetched for user 1789a3b506ef49af954278bb3e378578. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:28 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:28 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:28 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674" returned: 0 in 0.480s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:28 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a 1G Jul 22 20:54:28 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1121eae-befd-4fa8-acdf-606cfacc0637]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-quobyte-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75aa687-23fe-4161-b996-d9fce0dc6696]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:28 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD Jul 22 20:54:28 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.301s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Deleted volume successfully. Jul 22 20:54:28 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 Jul 22 20:54:28 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-50a96454-c839-480a-bfb0-a84d842645b2 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-e286e1b1-722d-4b8f-bdd1-6b1dfbe6ae97-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:29 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:29 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a 1G" returned: 0 in 0.498s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441ef8e9-088a-40fa-b053-ab9324aad674 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:29 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441ef8e9-088a-40fa-b053-ab9324aad674 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a Jul 22 20:54:29 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:29 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1" returned: 0 in 0.446s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:29 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD Jul 22 20:54:29 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:29 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1 Jul 22 20:54:29 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:29 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441ef8e9-088a-40fa-b053-ab9324aad674 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a" returned: 0 in 0.326s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a is being set with open permissions: ugo+rw Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:29 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:29 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1" released by "delete_volume" :: held 0.762s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:29 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created reservations ['b8189607-f3f9-4c4a-9654-604a9b5065f3', '0c6e8f86-af41-4b1e-a820-0d95dcf22145', '16509a59-c5ae-451a-82e9-b6df52804b06', 'dd911f89-4dc0-478e-96a9-95f8d71cf556'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:29 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:29 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:29 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a" returned: 0 in 0.261s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:29 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.info Jul 22 20:54:29 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-quobyte-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d088103-60a2-42fe-9b6e-89e45e7cc9c2]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:29 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.290s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:29 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Deleted volume successfully. Jul 22 20:54:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4e85f939-4aba-42dc-aa64-e81bc85e2443 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-d4ae3142-bb49-47aa-9e87-9c2fcc1604f1-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:29 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d Jul 22 20:54:29 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:30 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.info" returned: 0 in 0.321s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:30 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.info is being set with open permissions: ugo+rw Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:30 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.info Jul 22 20:54:30 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:30 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:30 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d" returned: 0 in 0.471s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.info" returned: 0 in 0.315s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.335s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:30 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d Jul 22 20:54:30 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-788856705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a87fc1-d5a6-4ef5-a475-386a0a5cfa95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f0911ff52e4ffa9d2eafef21e519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:28Z,use_quota=True,user_id='e6f05ff1ce32430fa3d3450de84ae9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Creating volume 03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:30 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:30 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 1073741824 Jul 22 20:54:30 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9115a058-a717-4a6b-9342-8e1beb75114a tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:54:30 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d" returned: 0 in 0.273s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d" released by "delete_volume" :: held 0.791s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created reservations ['cae44697-7839-45f0-87c6-8bb90b68d7c5', '90c29761-acfc-4252-a7b6-0847e6f31c2c', '309ade13-f16a-4809-8a38-7b8c6ebbc180', 'f9c30799-4a9d-41ed-ae07-26b493b39234'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:30 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:30 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:30 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 1073741824" returned: 0 in 0.469s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:30 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 Jul 22 20:54:30 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-ca85a298-1894-4fec-a03e-ba429c3c05bd-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-ca85a298-1894-4fec-a03e-ba429c3c05bd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "cinder-quobyte-ca85a298-1894-4fec-a03e-ba429c3c05bd" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:31 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.290s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-ca85a298-1894-4fec-a03e-ba429c3c05bd" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Deleted volume successfully. Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a52303-1811-4bdf-a5ff-ca2199b6ecd2]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d2990961-5a24-491c-b34a-2a97c35261e8 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-63668d7c-0a16-4d9f-941a-bc2a7c5d5b9d-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:31 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" returned: 0 in 0.301s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.762s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fa67e9a60048d383fd577ad71ee90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:27Z,use_quota=True,user_id='1789a3b506ef49af954278bb3e378578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Creating volume f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:31 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd Jul 22 20:54:31 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:31 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:31 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d 1073741824 Jul 22 20:54:31 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9467700a-43ed-4265-a971-944ade536d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac70902-7b6a-43d5-8877-ca69232e3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:31 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Volume volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 (03a87fc1-d5a6-4ef5-a475-386a0a5cfa95): created successfully Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac70902-7b6a-43d5-8877-ca69232e3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Flow 'volume_create_manager' (45339c4a-5d6c-4c7d-a775-472d00f573b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-b1f6678f-d90a-4c28-b597-cacd92753b6a-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e37a4f9f-2e9d-4969-813e-9876feb835e9 tempest-CinderUnicodeTest-1076901128 None] Created volume successfully. Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-b1f6678f-d90a-4c28-b597-cacd92753b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-441ef8e9-088a-40fa-b053-ab9324aad674" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-441ef8e9-088a-40fa-b053-ab9324aad674" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-b1f6678f-d90a-4c28-b597-cacd92753b6a" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-b1f6678f-d90a-4c28-b597-cacd92753b6a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot b1f6678f-d90a-4c28-b597-cacd92753b6a of volume 441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462e5a0-8c1d-4174-abe1-4680e193bc8c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:31 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd" returned: 0 in 0.467s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:31 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd Jul 22 20:54:31 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:31 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a Jul 22 20:54:31 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:31 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d 1073741824" returned: 0 in 0.585s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:31 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d Jul 22 20:54:31 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:31 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-ca85a298-1894-4fec-a03e-ba429c3c05bd" returned: 0 in 0.335s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-quobyte-ca85a298-1894-4fec-a03e-ba429c3c05bd" released by "delete_volume" :: held 0.849s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:31 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a" returned: 0 in 0.431s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-441ef8e9-088a-40fa-b053-ab9324aad674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4507c70-498c-4b9e-a8c6-15aff4b5b23f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:31 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Created reservations ['a2ba9385-c148-4b2c-9ab7-fe981b379edc', '6a2ceefb-7240-4129-b7bd-47af9e8acab0', '23e7daa2-1d48-4365-a278-bd50dff98fef', '9262a425-fafe-49ab-a7f1-a0f6b06658cd'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:32 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 Jul 22 20:54:32 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:32 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:32 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:32 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.360s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Creating offline snapshot 16f37a2f-ea1f-4ebe-866f-887cd9fa2476 of volume 03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Attempting download of 1b549891-1ffb-48fa-9e68-1b14e09cfdca ((None, [{'url': 'file:///opt/stack/data/glance/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'metadata': {}}])) to volume f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1a8a94-0042-4587-b0f3-c01638cef884]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce46784-3b86-4037-b47d-851aa157a03d]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b549891-1ffb-48fa-9e68-1b14e09cfdca_d04b8i7t {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:32 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 Jul 22 20:54:32 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:32 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.297s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:32 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Deleted volume successfully. Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f50527ed-b403-4a12-9708-e46770bdb508 tempest-CreateVolumesFromSourceVolumeTest-2029022476 None] Lock "cinder-ca85a298-1894-4fec-a03e-ba429c3c05bd-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:32 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b549891-1ffb-48fa-9e68-1b14e09cfdca_d04b8i7t Jul 22 20:54:32 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:32 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674" returned: 0 in 0.554s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:32 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a Jul 22 20:54:32 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:32 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b549891-1ffb-48fa-9e68-1b14e09cfdca_d04b8i7t" returned: 0 in 0.471s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b549891-1ffb-48fa-9e68-1b14e09cfdca_d04b8i7t {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:32 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" returned: 0 in 0.559s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:32 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 1G Jul 22 20:54:32 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:32 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b549891-1ffb-48fa-9e68-1b14e09cfdca_d04b8i7t Jul 22 20:54:32 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:32 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a" returned: 0 in 0.511s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:33 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a Jul 22 20:54:33 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:33 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b549891-1ffb-48fa-9e68-1b14e09cfdca_d04b8i7t" returned: 1 in 0.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b549891-1ffb-48fa-9e68-1b14e09cfdca_d04b8i7t' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b1f1b1-ca78-4dbf-9b80-23dc59436639]: (4, 'raw') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:33 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD Jul 22 20:54:33 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:33 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674.b1f6678f-d90a-4c28-b597-cacd92753b6a" returned: 0 in 0.301s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:33 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 1G" returned: 0 in 0.573s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:33 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 Jul 22 20:54:33 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-b1f6678f-d90a-4c28-b597-cacd92753b6a" released by "_delete_snapshot" :: held 1.956s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-441ef8e9-088a-40fa-b053-ab9324aad674" released by "delete_snapshot" :: held 1.997s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Created reservations ['41c5b905-17d0-4bf5-a674-8c81633ffb75', '8bb82a55-7095-46ed-8fe5-4942d0abf5b8', '220e60ec-a004-49c9-8a50-9c943ea93996', '099b8b0d-b0ad-4785-87aa-d2eed48f84a3'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:33 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:33 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-69190de3-3c4b-4faa-9e8b-5d4072846545 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-b1f6678f-d90a-4c28-b597-cacd92753b6a-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:33 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD Jul 22 20:54:33 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:33 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476" returned: 0 in 0.475s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:33 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 is being set with open permissions: ugo+rw Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:33 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 Jul 22 20:54:33 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:33 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] 1b549891-1ffb-48fa-9e68-1b14e09cfdca was raw, converting to qcow2 {{(pid=87818) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 20:54:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:33 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d Jul 22 20:54:33 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:34 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476" returned: 0 in 0.261s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:34 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.info Jul 22 20:54:34 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:34 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.info" returned: 0 in 0.320s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:34 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.info is being set with open permissions: ugo+rw Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:34 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d" returned: 0 in 0.485s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b549891-1ffb-48fa-9e68-1b14e09cfdca_pghy6t0bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:54:34 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:34 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.info Jul 22 20:54:34 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:34 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d 1G Jul 22 20:54:34 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-441ef8e9-088a-40fa-b053-ab9324aad674-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Lock "cinder-441ef8e9-088a-40fa-b053-ab9324aad674-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:34 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.info" returned: 0 in 0.312s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-441ef8e9-088a-40fa-b053-ab9324aad674" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:34 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-fe7fee3f-b926-4c9d-a889-deccd23239a1 tempest-CinderUnicodeTest-1076901128 None] Create snapshot completed successfully Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-441ef8e9-088a-40fa-b053-ab9324aad674" acquired by "delete_volume" :: waited 0.034s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:34 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d 1G" returned: 0 in 0.412s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Downloaded image 1b549891-1ffb-48fa-9e68-1b14e09cfdca ((None, [{'url': 'file:///opt/stack/data/glance/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'metadata': {}}])) to volume f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d successfully. {{(pid=87818) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Temporary image 1b549891-1ffb-48fa-9e68-1b14e09cfdca for user 1789a3b506ef49af954278bb3e378578 is deleted. {{(pid=87818) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.volume_utils [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Marking volume f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d as bootable. {{(pid=87818) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Copying metadata from image 1b549891-1ffb-48fa-9e68-1b14e09cfdca to f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d. {{(pid=87818) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Creating volume glance metadata for volume f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d backed by image 1b549891-1ffb-48fa-9e68-1b14e09cfdca with: {'image_id': '1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4aa461634bdac4027ff1476958ebc2a1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87818) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e55d68-7fb5-40e4-a414-1d712fcd9cb1]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547b4be0-5a62-4e90-9d08-9f40d64771d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d', 'volume_size': 1, 'image_id': '1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4aa461634bdac4027ff1476958ebc2a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01fa67e9a60048d383fd577ad71ee90a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10c5679e186aa98c3e4c22f1d53862a32352c0c9b5b813ed1afe0b75467096dd6808c513fc60e4b6aa11d4462db28facd8c04d947928ae8af181bae0741394a2', 'id': '1b549891-1ffb-48fa-9e68-1b14e09cfdca', 'created_at': datetime.datetime(2026, 7, 22, 18, 54, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 18, 54, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b549891-1ffb-48fa-9e68-1b14e09cfdca/file', 'properties': {}}, 'image_service': }' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598c14a4-ba86-4acc-aa5b-afbe3bc14bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "cinder-16f37a2f-ea1f-4ebe-866f-887cd9fa2476-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:34 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Volume volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d (f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d): created successfully Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598c14a4-ba86-4acc-aa5b-afbe3bc14bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Flow 'volume_create_manager' (3b305f49-a5d9-4f9a-919c-9ca13e86cf5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-16f37a2f-ea1f-4ebe-866f-887cd9fa2476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "cinder-quobyte-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0c2fa845-1333-424b-b33f-b9234e0642de tempest-VolumeImageDependencyTests-2115222711 None] Created volume successfully. Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "cinder-quobyte-16f37a2f-ea1f-4ebe-866f-887cd9fa2476" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:35 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 Jul 22 20:54:35 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-16f37a2f-ea1f-4ebe-866f-887cd9fa2476" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Deleting offline snapshot 16f37a2f-ea1f-4ebe-866f-887cd9fa2476 of volume 03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] snapshot_file for this snap is: volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[523913a9-558c-4455-b7c6-5fb3b96670d3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:35 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 Jul 22 20:54:35 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:35 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674" returned: 0 in 0.472s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:35 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674 Jul 22 20:54:35 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:35 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476" returned: 0 in 0.401s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a1249-4eba-46fd-83d2-f65154ee720e]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:35 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-441ef8e9-088a-40fa-b053-ab9324aad674" returned: 0 in 0.286s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-441ef8e9-088a-40fa-b053-ab9324aad674" released by "delete_volume" :: held 0.854s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:35 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 Jul 22 20:54:35 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Created reservations ['f0f85465-89c4-45be-b40a-3f54392630b3', '49b4838d-9ece-4fab-85b6-3bee2b1dafd4', '414d1c17-dbf5-4398-bad8-11be30a45ec1', '70eee5fa-1122-45d6-8b1c-cd524ebd75ff'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:35 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:35 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Acquiring lock "cinder-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Lock "cinder-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Acquiring lock "cinder-quobyte-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:36 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" returned: 0 in 0.557s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Lock "cinder-quobyte-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d" acquired by "delete_volume" :: waited 0.038s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:36 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 Jul 22 20:54:36 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[320092af-fc1b-4a41-abd9-2f32ff63f608]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:36 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:36 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f1f7b69d-4741-4fbf-9b77-bcf2301cc8ad tempest-ProjectMemberTests-1773716304 None] Lock "cinder-441ef8e9-088a-40fa-b053-ab9324aad674-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:36 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d Jul 22 20:54:36 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:36 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (003842bd-8edf-4b3a-8095-e786fb4075d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845efcbe-6246-4ca5-9e00-2fe493393abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476" returned: 0 in 0.433s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845efcbe-6246-4ca5-9e00-2fe493393abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551660859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f0c7fd-216e-4c21-9c79-f7c7d326994d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:36Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:36 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476 Jul 22 20:54:36 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a64d96-2864-41cc-960b-67a9595b5ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a64d96-2864-41cc-960b-67a9595b5ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49677407-8912-4c31-81ac-53e1c877bb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49677407-8912-4c31-81ac-53e1c877bb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f0c7fd-216e-4c21-9c79-f7c7d326994d', 'volume_name': 'volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78808de-f63e-427f-b023-5a6d2500c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78808de-f63e-427f-b023-5a6d2500c746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1e0988-5be2-4a74-9ab8-464c94934de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:36 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Volume 50f0c7fd-216e-4c21-9c79-f7c7d326994d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d', 'volume_size': 1} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551660859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f0c7fd-216e-4c21-9c79-f7c7d326994d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:36Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:36 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Creating volume 50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:36 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d" returned: 0 in 0.481s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:36 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d 1073741824 Jul 22 20:54:36 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:36 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d Jul 22 20:54:36 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:36 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95.16f37a2f-ea1f-4ebe-866f-887cd9fa2476" returned: 0 in 0.270s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-16f37a2f-ea1f-4ebe-866f-887cd9fa2476" released by "_delete_snapshot" :: held 1.812s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" released by "delete_snapshot" :: held 1.842s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:36 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d" returned: 0 in 0.281s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Lock "cinder-quobyte-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d" released by "delete_volume" :: held 0.826s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:36 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Created reservations ['a0c63966-669c-4f85-bea9-331838bfdf6c', '9ab1b5c0-8c42-4920-98f4-07428e05142b', 'bd979b9c-072c-4d1c-a83a-7d441754a13e', '83f9906b-1c23-451c-b149-4dbe9cf3a182'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Created reservations ['2473d6a8-24ba-4912-9261-3636a7f649b5', '4e5931b8-8727-462c-be95-e3613a7c3430', '19ea826c-33d2-47e9-badd-1d76f281b770', '684c85a3-8768-4280-90e0-87927ec94419'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Delete snapshot completed successfully. Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b16caf29-ab83-4f64-b068-cd102b1205b3 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-16f37a2f-ea1f-4ebe-866f-887cd9fa2476-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:37 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:37 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "cinder-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:37 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d 1073741824" returned: 0 in 0.619s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:37 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d Jul 22 20:54:37 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "cinder-quobyte-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" acquired by "delete_volume" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cfa6e5-1836-4ab8-96d0-763dc8493bf8]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:37 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.496s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Deleted volume successfully. Jul 22 20:54:37 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 Jul 22 20:54:37 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4919c934-9b80-4f52-9f27-40ba4cce53de tempest-VolumeImageDependencyTests-2115222711 None] Lock "cinder-f0cf447e-a9d6-4b14-bcb5-72ccabbcc03d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:37 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d" returned: 0 in 0.381s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1e0988-5be2-4a74-9ab8-464c94934de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd10e9c-5cd9-411d-aa66-c1ea77b74383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:37 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Volume volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d (50f0c7fd-216e-4c21-9c79-f7c7d326994d): created successfully Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd10e9c-5cd9-411d-aa66-c1ea77b74383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (003842bd-8edf-4b3a-8095-e786fb4075d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-75c9567f-3a2a-4971-ae14-141042d61192 tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:54:37 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" returned: 0 in 0.480s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:37 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95 Jul 22 20:54:37 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:38 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" returned: 0 in 0.267s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95" released by "delete_volume" :: held 0.848s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Created reservations ['98874689-d1cf-4e52-990b-a95a84a13034', 'bee1acbc-f06e-4b80-b5d2-a30eae28f874', 'd6b4f9c3-5c13-49bd-8c16-26a0470a6a6b', '76efacd5-7959-46b6-a421-58499f840190'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:38 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:38 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "cinder-72e264ba-e0d9-49e8-9bbf-76054155dd14-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-72e264ba-e0d9-49e8-9bbf-76054155dd14-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "cinder-quobyte-72e264ba-e0d9-49e8-9bbf-76054155dd14" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-72e264ba-e0d9-49e8-9bbf-76054155dd14" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2eff6-6dee-46dc-8e55-2c00e73f551a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:38 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 Jul 22 20:54:38 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:38 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.417s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Deleted volume successfully. Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-b6e354ca-b478-4e34-b4b3-228a06d1e284 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-03a87fc1-d5a6-4ef5-a475-386a0a5cfa95-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot 2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 of volume 50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c96d5-332f-47fe-8d69-31fdaa08ba42]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:39 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14" returned: 0 in 0.458s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:39 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d Jul 22 20:54:39 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:39 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14 Jul 22 20:54:39 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:39 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-72e264ba-e0d9-49e8-9bbf-76054155dd14" returned: 0 in 0.338s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-quobyte-72e264ba-e0d9-49e8-9bbf-76054155dd14" released by "delete_volume" :: held 0.866s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:39 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d" returned: 0 in 0.527s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:39 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 1G Jul 22 20:54:39 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Created reservations ['eb10c76a-9069-4061-ab2a-0ea3e6a6b91c', 'd5cc7502-20dd-4222-9315-c4aab3542b72', 'caa1eefb-13ca-4b81-86e2-bf7d8a2e4b86', 'd345ab91-6371-4b89-af22-8d4639eded87'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:39 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:39 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:40 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 1G" returned: 0 in 0.653s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:40 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:40 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.501s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:40 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:40 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Deleted volume successfully. Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-08d104b3-aa4f-4bc2-ad7d-29f7766a22a5 tempest-CinderUnicodeTest-1076901128 None] Lock "cinder-72e264ba-e0d9-49e8-9bbf-76054155dd14-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:40 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" returned: 0 in 0.354s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:40 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 is being set with open permissions: ugo+rw Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:40 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 Jul 22 20:54:40 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:40 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" returned: 0 in 0.296s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:40 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.info Jul 22 20:54:40 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:41 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.info" returned: 0 in 0.274s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:41 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.info is being set with open permissions: ugo+rw Jul 22 20:54:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:41 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.info Jul 22 20:54:41 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:54:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:54:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:54:41 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.info" returned: 0 in 0.375s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f89d5251-eb37-4210-a276-21110a2ec57b tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-0c33add4-489f-4f21-99c0-c698ff3d6f46 tempest-ProjectAdminTests-222936627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87818) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-50f0c7fd-216e-4c21-9c79-f7c7d326994d" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-50f0c7fd-216e-4c21-9c79-f7c7d326994d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot 2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 of volume 50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea7ec6-3920-4603-b222-3838ff15369c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:42 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 Jul 22 20:54:42 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:42 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" returned: 0 in 0.495s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeaed21-4262-4100-ba4a-2582876e95ff]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:42 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d Jul 22 20:54:42 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:43 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d" returned: 0 in 0.535s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:43 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 Jul 22 20:54:43 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:43 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" returned: 0 in 0.500s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:43 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77 Jul 22 20:54:43 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:44 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d.2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" returned: 0 in 0.305s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77" released by "_delete_snapshot" :: held 1.990s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-50f0c7fd-216e-4c21-9c79-f7c7d326994d" released by "delete_snapshot" :: held 2.027s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:44 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Created reservations ['b28f42e4-caa0-400a-9ad8-4d298a5de7bf', 'c543e2dd-687b-47ed-8c13-addeef0e0b72', '230ac2c6-f4f3-48a4-a159-522976f89d4c', '1d16a29b-d2e5-41ef-8c0e-872d35903890'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:54:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9e83a3a0-2c3a-4343-9385-4a1c7b0a15a7 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-2f4f49d5-5430-4e27-9d8d-4fa94fbbfe77-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-50f0c7fd-216e-4c21-9c79-f7c7d326994d-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-50f0c7fd-216e-4c21-9c79-f7c7d326994d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-50f0c7fd-216e-4c21-9c79-f7c7d326994d" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:45 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-50f0c7fd-216e-4c21-9c79-f7c7d326994d" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:45 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b7b5fb-d5af-42cc-a695-9332f8088f4a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:45 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d Jul 22 20:54:45 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:46 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d" returned: 0 in 0.545s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:46 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d Jul 22 20:54:46 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:46 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-50f0c7fd-216e-4c21-9c79-f7c7d326994d" returned: 0 in 0.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-50f0c7fd-216e-4c21-9c79-f7c7d326994d" released by "delete_volume" :: held 0.944s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Created reservations ['222f453d-aa66-4c89-b8eb-9824d377d997', '24dac2e4-aecd-4297-85a6-4020f1a055d9', '105b1feb-4067-4b22-a534-62ae6eed8087', '32a887cc-ba8a-4500-ad98-3974dc320011'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:46 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:46 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:47 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.324s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:47 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:54:47 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=237,cinder:UPDATE=345,cinder:DELETE=28,cinder:INSERT=83 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:54:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-81fbe30c-eb5c-4147-bec7-71340376b215 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-50f0c7fd-216e-4c21-9c79-f7c7d326994d-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=254,cinder:UPDATE=317,cinder:INSERT=95,cinder:DELETE=30 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (4c0a6361-d461-484c-a97c-b8c46792ea0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1e1fb6-bb89-4278-aeb5-1199b37f6f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1e1fb6-bb89-4278-aeb5-1199b37f6f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709652447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235cea1b-f56c-4239-a8f0-12795e8433bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:48Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d7ff48-4bd2-444b-b4da-ecaecd802483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d7ff48-4bd2-444b-b4da-ecaecd802483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bf1003-78aa-43d4-b535-564a055b92ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bf1003-78aa-43d4-b535-564a055b92ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235cea1b-f56c-4239-a8f0-12795e8433bf', 'volume_name': 'volume-235cea1b-f56c-4239-a8f0-12795e8433bf', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6c09b3-178c-4cd6-b85d-b60249ff1310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6c09b3-178c-4cd6-b85d-b60249ff1310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfe559-994d-43a8-8913-4ff25431fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:48 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Volume 235cea1b-f56c-4239-a8f0-12795e8433bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235cea1b-f56c-4239-a8f0-12795e8433bf', 'volume_size': 1} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709652447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235cea1b-f56c-4239-a8f0-12795e8433bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:48Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Creating volume 235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:48 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:48 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf 1073741824 Jul 22 20:54:48 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:49 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf 1073741824" returned: 0 in 0.592s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:49 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf Jul 22 20:54:49 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:49 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf" returned: 0 in 0.378s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfe559-994d-43a8-8913-4ff25431fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235cea1b-f56c-4239-a8f0-12795e8433bf', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae163e7-eabe-4766-af0b-3c8fd6d22849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:49 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Volume volume-235cea1b-f56c-4239-a8f0-12795e8433bf (235cea1b-f56c-4239-a8f0-12795e8433bf): created successfully Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae163e7-eabe-4766-af0b-3c8fd6d22849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:49 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (4c0a6361-d461-484c-a97c-b8c46792ea0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-22655939-54d6-4a72-98d3-0a53ce43632f tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:54:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot 18360e1e-2920-4d75-a710-b9baefbb3849 of volume 235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:54:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4a18aa-49ad-4901-b702-591c0d2fb6c7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:51 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf Jul 22 20:54:51 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:51 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf" returned: 0 in 0.533s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:51 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 1G Jul 22 20:54:51 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:52 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 1G" returned: 0 in 0.683s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235cea1b-f56c-4239-a8f0-12795e8433bf -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:52 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235cea1b-f56c-4239-a8f0-12795e8433bf -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 Jul 22 20:54:52 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (aab316d4-0b35-4394-8717-b3e81b96ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f613e65-5cbe-416a-987a-d5f59e3db079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f613e65-5cbe-416a-987a-d5f59e3db079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778639324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d8b443-81b4-4338-8076-6763fa043a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:53Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8462ea2-f604-49aa-a0ff-72c8023accb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8462ea2-f604-49aa-a0ff-72c8023accb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:52 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2852bcb-6992-40e6-b18d-728624113e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2852bcb-6992-40e6-b18d-728624113e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d8b443-81b4-4338-8076-6763fa043a13', 'volume_name': 'volume-e1d8b443-81b4-4338-8076-6763fa043a13', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb81c0b-d903-42d5-a4fd-2fe972f8383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb81c0b-d903-42d5-a4fd-2fe972f8383f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cb3aa0-bd0f-4e49-8538-9825155823ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:52 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Volume e1d8b443-81b4-4338-8076-6763fa043a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d8b443-81b4-4338-8076-6763fa043a13', 'volume_size': 1} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235cea1b-f56c-4239-a8f0-12795e8433bf -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849" returned: 0 in 0.674s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:52 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 is being set with open permissions: ugo+rw Jul 22 20:54:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:52 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 Jul 22 20:54:52 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:53 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849" returned: 0 in 0.359s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:53 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.info Jul 22 20:54:53 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:53 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.info" returned: 0 in 0.326s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:53 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.info is being set with open permissions: ugo+rw Jul 22 20:54:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:53 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.info Jul 22 20:54:53 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:53 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.info" returned: 0 in 0.404s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778639324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d8b443-81b4-4338-8076-6763fa043a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:54:53Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Creating volume e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:54:54 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:54 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 1073741824 Jul 22 20:54:54 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:54 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-143a5adf-51b7-4242-a5a9-97718cbacfeb tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:54:54 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 1073741824" returned: 0 in 0.696s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:54 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 Jul 22 20:54:54 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:55 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13" returned: 0 in 0.438s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cb3aa0-bd0f-4e49-8538-9825155823ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d8b443-81b4-4338-8076-6763fa043a13', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6ea9ad-0596-43e5-a4ee-06213ac62a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-18360e1e-2920-4d75-a710-b9baefbb3849-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:55 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Volume volume-e1d8b443-81b4-4338-8076-6763fa043a13 (e1d8b443-81b4-4338-8076-6763fa043a13): created successfully Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6ea9ad-0596-43e5-a4ee-06213ac62a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (aab316d4-0b35-4394-8717-b3e81b96ed81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-18360e1e-2920-4d75-a710-b9baefbb3849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-235cea1b-f56c-4239-a8f0-12795e8433bf" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4d52c67c-207b-48f0-aecc-d0cc6d9653ee tempest-ProjectReaderTests-134062537 None] Created volume successfully. Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-235cea1b-f56c-4239-a8f0-12795e8433bf" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-18360e1e-2920-4d75-a710-b9baefbb3849" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-18360e1e-2920-4d75-a710-b9baefbb3849" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot 18360e1e-2920-4d75-a710-b9baefbb3849 of volume 235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[851024b0-8533-4488-a032-0c0d3ed2944c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:55 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 Jul 22 20:54:55 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:55 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849" returned: 0 in 0.456s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-235cea1b-f56c-4239-a8f0-12795e8433bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e0e3b-6785-4d85-97f2-95570ed5857a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:56 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf Jul 22 20:54:56 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Creating offline snapshot d0e0cb81-dd53-488c-9c18-c464e68596c0 of volume e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[05846db0-a195-4d08-ab8b-b9ea39201cdc]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:56 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 Jul 22 20:54:56 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:56 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf" returned: 0 in 0.456s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:56 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 Jul 22 20:54:56 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:56 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13" returned: 0 in 0.476s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:56 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 1G Jul 22 20:54:56 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:56 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849" returned: 0 in 0.439s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:56 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849 Jul 22 20:54:56 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:57 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf.18360e1e-2920-4d75-a710-b9baefbb3849" returned: 0 in 0.330s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:57 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 1G" returned: 0 in 0.565s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d8b443-81b4-4338-8076-6763fa043a13 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-18360e1e-2920-4d75-a710-b9baefbb3849" released by "_delete_snapshot" :: held 1.834s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-235cea1b-f56c-4239-a8f0-12795e8433bf" released by "delete_snapshot" :: held 1.879s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:57 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d8b443-81b4-4338-8076-6763fa043a13 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 Jul 22 20:54:57 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Created reservations ['762c13d3-6c42-42c1-b3fa-352cc052595e', 'b8831b88-6c33-453e-a22c-16e65efed20c', '86ea8fa3-98dc-4848-a62d-19f9c85fba50', '493d6f18-05a8-43ea-87e8-1c12bfca1444'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-792ffa62-480e-47ad-b6b1-e35086c8a9a4 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-18360e1e-2920-4d75-a710-b9baefbb3849-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-235cea1b-f56c-4239-a8f0-12795e8433bf-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-235cea1b-f56c-4239-a8f0-12795e8433bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:57 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d8b443-81b4-4338-8076-6763fa043a13 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0" returned: 0 in 0.393s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:57 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 is being set with open permissions: ugo+rw Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:57 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 Jul 22 20:54:57 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-235cea1b-f56c-4239-a8f0-12795e8433bf" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-235cea1b-f56c-4239-a8f0-12795e8433bf" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13cafbe-f4e2-4e55-b27a-5330c51faa3b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:57 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0" returned: 0 in 0.399s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:58 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf Jul 22 20:54:58 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:58 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.info Jul 22 20:54:58 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:58 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:58 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf" returned: 0 in 0.475s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.info" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:58 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.info is being set with open permissions: ugo+rw Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:58 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf Jul 22 20:54:58 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:58 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.info Jul 22 20:54:58 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:58 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:58 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-235cea1b-f56c-4239-a8f0-12795e8433bf" returned: 0 in 0.265s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.info" returned: 0 in 0.268s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-235cea1b-f56c-4239-a8f0-12795e8433bf" released by "delete_volume" :: held 0.910s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:58 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6eebfe96-3184-4c86-b829-a74ffdaa5e9d tempest-ProjectReaderTests-134062537 None] Create snapshot completed successfully Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Created reservations ['b85b7e28-b1d2-4165-a897-5d4a7954805f', 'e82de60a-b0ff-498c-9ece-bc9f3f1632d9', '60fe60dd-162f-45cc-886e-43dc2e870c90', 'b50f72a4-fd3d-4d1f-859e-ac95be8a2132'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:54:58 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:58 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:54:58 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:54:59 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.288s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:54:59 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-80750bff-29a8-41cb-ba4e-dec0666d34cf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-235cea1b-f56c-4239-a8f0-12795e8433bf-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-d0e0cb81-dd53-488c-9c18-c464e68596c0-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Lock "cinder-d0e0cb81-dd53-488c-9c18-c464e68596c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-e1d8b443-81b4-4338-8076-6763fa043a13" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e1d8b443-81b4-4338-8076-6763fa043a13" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-d0e0cb81-dd53-488c-9c18-c464e68596c0" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-d0e0cb81-dd53-488c-9c18-c464e68596c0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Deleting offline snapshot d0e0cb81-dd53-488c-9c18-c464e68596c0 of volume e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] snapshot_file for this snap is: volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8e8b35-bff6-4bf3-8174-3a2cdca75af7]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:54:59 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:54:59 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 Jul 22 20:54:59 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:00 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0" returned: 0 in 0.463s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1d8b443-81b4-4338-8076-6763fa043a13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db15d1-291c-4ce1-82b0-4fdddbba8feb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:00 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 Jul 22 20:55:00 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (6d0f0eea-c94a-4734-89fe-d5b5a0283418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6184182d-c2a5-4ea0-93da-4837c1120f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6184182d-c2a5-4ea0-93da-4837c1120f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-609316529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5489b81-d271-4e7c-88e7-4b872f785e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:00Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78296163-21e2-41fc-9397-ab27ce2791ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78296163-21e2-41fc-9397-ab27ce2791ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8c54f8-dfad-473d-b48a-50f38a519cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8c54f8-dfad-473d-b48a-50f38a519cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5489b81-d271-4e7c-88e7-4b872f785e24', 'volume_name': 'volume-f5489b81-d271-4e7c-88e7-4b872f785e24', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9e556d-851d-43c4-8640-6dda2eaf543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9e556d-851d-43c4-8640-6dda2eaf543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4852e82d-46cc-40ee-9e5a-6de35bb02dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:00 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Volume f5489b81-d271-4e7c-88e7-4b872f785e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5489b81-d271-4e7c-88e7-4b872f785e24', 'volume_size': 1} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-609316529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5489b81-d271-4e7c-88e7-4b872f785e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:00Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Creating volume f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:00 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:00 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 1073741824 Jul 22 20:55:00 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:00 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13" returned: 0 in 0.485s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:00 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 Jul 22 20:55:00 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:00 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 1073741824" returned: 0 in 0.478s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:00 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0" returned: 0 in 0.439s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:00 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:01 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0 Jul 22 20:55:01 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:01 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 Jul 22 20:55:01 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:01 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13.d0e0cb81-dd53-488c-9c18-c464e68596c0" returned: 0 in 0.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:01 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24" returned: 0 in 0.337s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-d0e0cb81-dd53-488c-9c18-c464e68596c0" released by "_delete_snapshot" :: held 1.850s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4852e82d-46cc-40ee-9e5a-6de35bb02dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5489b81-d271-4e7c-88e7-4b872f785e24', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75cf069-34c3-408b-80be-08eaff0b8bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e1d8b443-81b4-4338-8076-6763fa043a13" released by "delete_snapshot" :: held 1.889s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:01 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Volume volume-f5489b81-d271-4e7c-88e7-4b872f785e24 (f5489b81-d271-4e7c-88e7-4b872f785e24): created successfully Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75cf069-34c3-408b-80be-08eaff0b8bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (6d0f0eea-c94a-4734-89fe-d5b5a0283418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:01 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-db94b0a1-3bed-4107-a2e6-08590c2c94b3 tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Created reservations ['3ce6a2e8-8b6a-44cc-8082-0e0f0ba640ea', '93a08d5c-b5da-465c-9266-ab006994a5cc', '4699210e-dd92-466c-9b72-3c4bb4ecb5e5', '0d97f4b8-88f8-4eb5-8d8e-d7b15bdffcc8'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:01 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Delete snapshot completed successfully. Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-938ff9e1-c03c-4a5f-acd6-fe2ce47ad347 tempest-ProjectReaderTests-134062537 None] Lock "cinder-d0e0cb81-dd53-488c-9c18-c464e68596c0-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-e1d8b443-81b4-4338-8076-6763fa043a13-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Lock "cinder-e1d8b443-81b4-4338-8076-6763fa043a13-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-e1d8b443-81b4-4338-8076-6763fa043a13" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e1d8b443-81b4-4338-8076-6763fa043a13" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8706b916-19ff-429f-8422-db424a258a78]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:01 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:02 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 Jul 22 20:55:02 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:02 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13" returned: 0 in 0.407s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:02 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13 Jul 22 20:55:02 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:02 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e1d8b443-81b4-4338-8076-6763fa043a13" returned: 0 in 0.327s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e1d8b443-81b4-4338-8076-6763fa043a13" released by "delete_volume" :: held 0.827s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot ae87d818-1d4a-44b7-9a84-f2b9f28cea9a of volume f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[303ce970-2015-41d0-ab01-5820529a7cc0]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Created reservations ['3400423b-668f-469a-ac40-cb74e5d39cff', '3d181f80-429e-4e40-bf3d-fbfb6ae16199', '7f68c2e5-d2a8-452e-a000-796f620dfa6f', 'b989f642-157a-442c-aebf-3bf810d44192'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:02 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 Jul 22 20:55:02 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:02 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:03 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:03 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:03 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.296s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:03 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:03 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Deleted volume successfully. Jul 22 20:55:03 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-1b0f3abb-3a61-4303-aa69-290630c71a06 tempest-ProjectReaderTests-134062537 None] Lock "cinder-e1d8b443-81b4-4338-8076-6763fa043a13-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:03 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24" returned: 0 in 0.557s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:03 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a 1G Jul 22 20:55:03 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:03 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a 1G" returned: 0 in 0.535s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:03 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5489b81-d271-4e7c-88e7-4b872f785e24 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:03 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5489b81-d271-4e7c-88e7-4b872f785e24 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a Jul 22 20:55:03 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:04 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5489b81-d271-4e7c-88e7-4b872f785e24 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" returned: 0 in 0.425s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:04 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a is being set with open permissions: ugo+rw Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:04 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a Jul 22 20:55:04 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:04 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" returned: 0 in 0.331s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:04 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.info Jul 22 20:55:04 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (aa32f736-2b3d-4e0c-8a0b-aebd7ca342cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb20573-1c36-40e0-99eb-c5a3b7db1f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb20573-1c36-40e0-99eb-c5a3b7db1f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547534459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a0835b-3cc5-4da0-8198-f5d4a55adbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:05Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ecb0d0-83cd-4312-b512-375a4e90e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ecb0d0-83cd-4312-b512-375a4e90e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c733c3a-c8ee-4cdd-aee3-470d32c91891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c733c3a-c8ee-4cdd-aee3-470d32c91891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a0835b-3cc5-4da0-8198-f5d4a55adbb5', 'volume_name': 'volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41255270-e2b5-4766-b881-f08448862f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41255270-e2b5-4766-b881-f08448862f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e42426-dac8-424c-9b4f-d60a07337342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Volume 29a0835b-3cc5-4da0-8198-f5d4a55adbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5', 'volume_size': 1} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:05 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.info" returned: 0 in 0.395s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:05 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.info is being set with open permissions: ugo+rw Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:05 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.info Jul 22 20:55:05 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:05 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.info" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547534459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a0835b-3cc5-4da0-8198-f5d4a55adbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:05Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Creating volume 29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:05 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-2d25724c-7340-4a54-bf60-0190f4e2521d tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:55:05 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 1073741824 Jul 22 20:55:05 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-ae87d818-1d4a-44b7-9a84-f2b9f28cea9a-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-ae87d818-1d4a-44b7-9a84-f2b9f28cea9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:05 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-f5489b81-d271-4e7c-88e7-4b872f785e24" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5489b81-d271-4e7c-88e7-4b872f785e24" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot ae87d818-1d4a-44b7-9a84-f2b9f28cea9a of volume f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:06 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 1073741824" returned: 0 in 0.679s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f21e6d-85b9-46d1-99f7-351113474e00]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:06 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 Jul 22 20:55:06 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:06 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a Jul 22 20:55:06 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:06 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" returned: 0 in 0.343s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e42426-dac8-424c-9b4f-d60a07337342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1464e5-6d61-461b-af2f-fbde1c1c8e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:06 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Volume volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 (29a0835b-3cc5-4da0-8198-f5d4a55adbb5): created successfully Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1464e5-6d61-461b-af2f-fbde1c1c8e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (aa32f736-2b3d-4e0c-8a0b-aebd7ca342cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:06 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-08082024-35b9-48cb-bc9c-5101393ee063 tempest-ProjectReaderTests-134062537 None] Created volume successfully. Jul 22 20:55:06 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" returned: 0 in 0.547s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5489b81-d271-4e7c-88e7-4b872f785e24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ac0557-8824-4362-804f-c145108b5fc0]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:06 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 Jul 22 20:55:06 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Creating offline snapshot ab833c9f-079b-4d9e-bdfd-18f32a57e044 of volume 29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:07 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24" returned: 0 in 0.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd547a9-8e78-43ee-a5d1-0b922ba67635]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:07 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a Jul 22 20:55:07 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:07 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 Jul 22 20:55:07 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:07 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" returned: 0 in 0.466s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:07 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a Jul 22 20:55:07 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:07 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" returned: 0 in 0.498s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:07 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 1G Jul 22 20:55:07 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:07 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24.ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" returned: 0 in 0.335s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-ae87d818-1d4a-44b7-9a84-f2b9f28cea9a" released by "_delete_snapshot" :: held 1.944s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5489b81-d271-4e7c-88e7-4b872f785e24" released by "delete_snapshot" :: held 1.992s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Created reservations ['f5bfc021-cd2f-4a35-a88c-e97f0c40d75d', '32aef250-6cb9-4c28-b140-2b1edc0da844', '562ecba2-f41f-4d34-8f94-ee1fbfb31235', '0c9dcffb-fce1-43e5-8034-d2b0632649da'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a5ce4550-d557-4235-ba38-8e076e2a2dd0 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-ae87d818-1d4a-44b7-9a84-f2b9f28cea9a-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:08 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 1G" returned: 0 in 0.672s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:08 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 Jul 22 20:55:08 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:08 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044" returned: 0 in 0.404s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:08 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 is being set with open permissions: ugo+rw Jul 22 20:55:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:08 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 Jul 22 20:55:08 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:09 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044" returned: 0 in 0.398s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:09 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.info Jul 22 20:55:09 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-f5489b81-d271-4e7c-88e7-4b872f785e24-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Lock "cinder-f5489b81-d271-4e7c-88e7-4b872f785e24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-f5489b81-d271-4e7c-88e7-4b872f785e24" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5489b81-d271-4e7c-88e7-4b872f785e24" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a77659-8d59-41c6-822e-1926f459fba3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Flow 'volume_create_manager' (9d8099bc-4d88-40d6-b626-c21d00572038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:09 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597118b1-4192-4496-9ce6-2bb97480a2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.info" returned: 0 in 0.307s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:09 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.info is being set with open permissions: ugo+rw Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597118b1-4192-4496-9ce6-2bb97480a2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1875048409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb45953-349b-4579-8229-239a87fcaf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846e3b3f6df047c1bc7883176c5f02c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:09Z,use_quota=True,user_id='b4397503251e44bca2c891cfd5a70078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:09 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.info Jul 22 20:55:09 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83ede13-e38f-4a10-bd7d-0eba65ffbaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:09 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 Jul 22 20:55:09 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83ede13-e38f-4a10-bd7d-0eba65ffbaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e1014e-028d-4dec-b3ea-f5175a6b1463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e1014e-028d-4dec-b3ea-f5175a6b1463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb45953-349b-4579-8229-239a87fcaf15', 'volume_name': 'volume-5fb45953-349b-4579-8229-239a87fcaf15', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38835bf1-6f3b-47af-944b-a3877ce178a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38835bf1-6f3b-47af-944b-a3877ce178a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b6465f-47bc-4d00-900a-62d7ea2c0d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:09 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Volume 5fb45953-349b-4579-8229-239a87fcaf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb45953-349b-4579-8229-239a87fcaf15', 'volume_size': 1} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:09 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.info" returned: 0 in 0.262s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:09 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1875048409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb45953-349b-4579-8229-239a87fcaf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846e3b3f6df047c1bc7883176c5f02c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:09Z,use_quota=True,user_id='b4397503251e44bca2c891cfd5a70078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Creating volume 5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:09 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24" returned: 0 in 0.410s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:09 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 1073741824 Jul 22 20:55:09 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a1c057d6-eb69-4ef5-949a-511ff1c4a14b tempest-ProjectReaderTests-134062537 None] Create snapshot completed successfully Jul 22 20:55:09 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24 Jul 22 20:55:09 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:10 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5489b81-d271-4e7c-88e7-4b872f785e24" returned: 0 in 0.301s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5489b81-d271-4e7c-88e7-4b872f785e24" released by "delete_volume" :: held 0.780s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Created reservations ['1cf98b83-5055-4e55-8f34-2d95bef91f51', 'fced405f-7206-4646-8a15-a91b93841c39', '7eac2b02-c1f9-4008-b51c-534923afb345', 'cc030bca-cdd5-42e2-8d77-26c5ddf6b947'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:10 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:10 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-ab833c9f-079b-4d9e-bdfd-18f32a57e044-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:10 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 1073741824" returned: 0 in 0.556s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Lock "cinder-ab833c9f-079b-4d9e-bdfd-18f32a57e044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-ab833c9f-079b-4d9e-bdfd-18f32a57e044" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-ab833c9f-079b-4d9e-bdfd-18f32a57e044" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Deleting offline snapshot ab833c9f-079b-4d9e-bdfd-18f32a57e044 of volume 29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:10 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 Jul 22 20:55:10 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] snapshot_file for this snap is: volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe2c30d-3fd3-4ccb-a909-53bc41cd3d6b]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:10 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 Jul 22 20:55:10 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:10 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.374s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-41c5e842-89a7-43f2-b064-8eb8fc6191bd tempest-ProjectMemberTests-1773716304 None] Lock "cinder-f5489b81-d271-4e7c-88e7-4b872f785e24-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:10 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15" returned: 0 in 0.408s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b6465f-47bc-4d00-900a-62d7ea2c0d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb45953-349b-4579-8229-239a87fcaf15', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb438d75-65c2-4bfc-a6db-b5c95f12e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Volume volume-5fb45953-349b-4579-8229-239a87fcaf15 (5fb45953-349b-4579-8229-239a87fcaf15): created successfully Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb438d75-65c2-4bfc-a6db-b5c95f12e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Flow 'volume_create_manager' (9d8099bc-4d88-40d6-b626-c21d00572038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:10 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-09f1bd8f-4628-40cc-90fb-c99790ee9bda tempest-SnapshotDependencyTests-1637006147 None] Created volume successfully. Jul 22 20:55:11 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044" returned: 0 in 0.489s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[741296ff-b990-4af2-b3a3-82cd27bd81fb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:11 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 Jul 22 20:55:11 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (7976f8ba-6df6-46a6-b2f6-e5267d081a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab40a4b-46db-4272-8579-5181d886c085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab40a4b-46db-4272-8579-5181d886c085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643363768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118ba107-89c5-437d-a3a2-1ab9ea707b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:11Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e30b2fe-94c1-4453-ac87-7d0bd40f07ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e30b2fe-94c1-4453-ac87-7d0bd40f07ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b7ea29-8c33-4b21-b444-ea23402ccd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b7ea29-8c33-4b21-b444-ea23402ccd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118ba107-89c5-437d-a3a2-1ab9ea707b70', 'volume_name': 'volume-118ba107-89c5-437d-a3a2-1ab9ea707b70', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b73c60-f02c-44ae-a614-559012e2ca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b73c60-f02c-44ae-a614-559012e2ca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec8d665-69df-4f3b-951e-f6348becdbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Volume 118ba107-89c5-437d-a3a2-1ab9ea707b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118ba107-89c5-437d-a3a2-1ab9ea707b70', 'volume_size': 1} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643363768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118ba107-89c5-437d-a3a2-1ab9ea707b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:11Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Creating volume 118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:11 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:11 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 1073741824 Jul 22 20:55:11 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:11 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" returned: 0 in 0.414s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:11 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 Jul 22 20:55:11 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:11 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:11 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044" returned: 0 in 0.466s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 1073741824" returned: 0 in 0.615s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:11 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044 Jul 22 20:55:11 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:12 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 Jul 22 20:55:12 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:12 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5.ab833c9f-079b-4d9e-bdfd-18f32a57e044" returned: 0 in 0.317s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-ab833c9f-079b-4d9e-bdfd-18f32a57e044" released by "_delete_snapshot" :: held 1.832s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" released by "delete_snapshot" :: held 1.887s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Created reservations ['94ebb281-dc3c-4518-82d6-b68f80ccb051', '5c608e42-faa5-480f-92ef-542a1915fd4c', '808c3632-b6be-4feb-8f0e-bd0e231429d5', 'a4c3807c-4d5a-4175-86ee-b3e5308cd36d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:12 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70" returned: 0 in 0.358s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec8d665-69df-4f3b-951e-f6348becdbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118ba107-89c5-437d-a3a2-1ab9ea707b70', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c4dbca-6434-4f5a-a872-9de83d9f559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Creating offline snapshot add0741e-8ed3-413f-82b4-0710739bfb76 of volume 5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Volume volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 (118ba107-89c5-437d-a3a2-1ab9ea707b70): created successfully Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c4dbca-6434-4f5a-a872-9de83d9f559f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (7976f8ba-6df6-46a6-b2f6-e5267d081a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8cc474-e7bf-43e1-a007-f3fdb9274578]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-756093b7-0e36-4cdc-ab55-24dbf1c880bc tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:55:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Delete snapshot completed successfully. Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc6e3e68-94ef-467e-ba83-1d61227516fc tempest-ProjectReaderTests-134062537 None] Lock "cinder-ab833c9f-079b-4d9e-bdfd-18f32a57e044-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-29a0835b-3cc5-4da0-8198-f5d4a55adbb5-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Lock "cinder-29a0835b-3cc5-4da0-8198-f5d4a55adbb5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:12 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 Jul 22 20:55:12 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9144287-16a5-48b0-9b7c-2673680a1b7a]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:12 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 Jul 22 20:55:12 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:12 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15" returned: 0 in 0.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:12 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 1G Jul 22 20:55:12 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:13 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" returned: 0 in 0.428s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:13 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5 Jul 22 20:55:13 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:13 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" returned: 0 in 0.325s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:13 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 1G" returned: 0 in 0.555s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb45953-349b-4579-8229-239a87fcaf15 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-29a0835b-3cc5-4da0-8198-f5d4a55adbb5" released by "delete_volume" :: held 0.843s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:13 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb45953-349b-4579-8229-239a87fcaf15 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 Jul 22 20:55:13 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Created reservations ['3823acd9-636a-4b90-bc3e-88eccb922b3f', '998fd68c-4194-4086-8f04-33b766ce44d8', '748a40aa-610a-4f26-87c5-24e7c4e1fcc6', '3bcc3a0d-4065-4c4a-9156-bfba35dd0cc1'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:13 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:13 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:13 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb45953-349b-4579-8229-239a87fcaf15 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76" returned: 0 in 0.409s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:13 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 is being set with open permissions: ugo+rw Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:13 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 Jul 22 20:55:13 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:13 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.305s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:13 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Deleted volume successfully. Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d1487955-3684-448d-9872-c548a941d5c7 tempest-ProjectReaderTests-134062537 None] Lock "cinder-29a0835b-3cc5-4da0-8198-f5d4a55adbb5-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:14 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76" returned: 0 in 0.316s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:14 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.info Jul 22 20:55:14 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (734619a6-2854-4a34-9c60-828f8f1bc8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a023f7-f387-435d-bf0d-04e1ae7f4780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a023f7-f387-435d-bf0d-04e1ae7f4780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606588591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1e2c7a-d197-4318-8af7-4685cf3def35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:14Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27aea1b2-6bb7-4c63-b31a-ccc4b93f8e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27aea1b2-6bb7-4c63-b31a-ccc4b93f8e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1996510d-8e24-41ee-85f2-a7377774050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1996510d-8e24-41ee-85f2-a7377774050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1e2c7a-d197-4318-8af7-4685cf3def35', 'volume_name': 'volume-9c1e2c7a-d197-4318-8af7-4685cf3def35', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cace96-849a-4661-ae3a-e26a0a300f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cace96-849a-4661-ae3a-e26a0a300f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0757eb-d16a-43aa-8a5b-f77a15b0d2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:14 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Volume 9c1e2c7a-d197-4318-8af7-4685cf3def35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1e2c7a-d197-4318-8af7-4685cf3def35', 'volume_size': 1} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:14 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.info" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:14 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.info is being set with open permissions: ugo+rw Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:14 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.info Jul 22 20:55:14 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:14 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.info" returned: 0 in 0.251s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.240s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot e2ba2fed-582f-4c9b-b297-ae86ed743397 of volume 118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-371f3691-fdd6-4d44-9e44-37747e71f02e tempest-SnapshotDependencyTests-1637006147 None] Create snapshot completed successfully Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f737cb-016f-4fdf-a538-7a2c9e486965]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:14 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 Jul 22 20:55:14 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Flow 'volume_create_manager' (4f62c2ac-d160-49f9-9bca-cbc22b72617d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8450b93-66a7-4284-9533-ae803407168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8450b93-66a7-4284-9533-ae803407168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454324252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc257f18-3a13-4e66-82f0-859d572b066c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb18c917e6634bce9492447f7cbd0332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:15Z,use_quota=True,user_id='fe0cd2b5b528490caa2d765b06c0c4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67868668-1680-4a68-9aba-aca05d56211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67868668-1680-4a68-9aba-aca05d56211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb86aff-7e88-4056-8f3b-525c817d24df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb86aff-7e88-4056-8f3b-525c817d24df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc257f18-3a13-4e66-82f0-859d572b066c', 'volume_name': 'volume-dc257f18-3a13-4e66-82f0-859d572b066c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e55b77-6494-495b-9425-ee88e7344e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e55b77-6494-495b-9425-ee88e7344e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f11736-d97b-4f72-a09c-b41ce6533e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Volume dc257f18-3a13-4e66-82f0-859d572b066c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc257f18-3a13-4e66-82f0-859d572b066c', 'volume_size': 1} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:15 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70" returned: 0 in 0.404s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:15 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 1G Jul 22 20:55:15 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Flow 'volume_create_manager' (7ec787e3-8f6f-4678-9c94-89b72ba9ae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dd1c61-22ee-4849-84d3-e452594279c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dd1c61-22ee-4849-84d3-e452594279c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f65aee-7688-4198-8962-3e9fee2ba3ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846e3b3f6df047c1bc7883176c5f02c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=add0741e-8ed3-413f-82b4-0710739bfb76,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:16Z,use_quota=True,user_id='b4397503251e44bca2c891cfd5a70078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bb6bee-cb9f-4bb4-8911-3df5a1a33998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bb6bee-cb9f-4bb4-8911-3df5a1a33998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacad776-2c4c-44b3-ad16-fddf799a84f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacad776-2c4c-44b3-ad16-fddf799a84f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84f65aee-7688-4198-8962-3e9fee2ba3ea', 'volume_name': 'volume-84f65aee-7688-4198-8962-3e9fee2ba3ea', 'volume_size': 1, 'snapshot_id': 'add0741e-8ed3-413f-82b4-0710739bfb76'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b93f1ee-c2f3-40ba-b20a-ccc464a64d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b93f1ee-c2f3-40ba-b20a-ccc464a64d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078f2c1d-ce71-4b38-a365-d86d13156947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:15 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Volume 84f65aee-7688-4198-8962-3e9fee2ba3ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84f65aee-7688-4198-8962-3e9fee2ba3ea', 'volume_size': 1, 'snapshot_id': 'add0741e-8ed3-413f-82b4-0710739bfb76'} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 1G" returned: 0 in 0.534s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:15 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:15 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 Jul 22 20:55:15 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:16 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397" returned: 0 in 0.297s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:16 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 is being set with open permissions: ugo+rw Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:16 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 Jul 22 20:55:16 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:16 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397" returned: 0 in 0.256s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:16 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.info Jul 22 20:55:16 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:16 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.info" returned: 0 in 0.248s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:16 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.info is being set with open permissions: ugo+rw Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:16 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.info Jul 22 20:55:16 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:16 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.info" returned: 0 in 0.243s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.476s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606588591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1e2c7a-d197-4318-8af7-4685cf3def35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:14Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Creating volume 9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:16 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:16 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:16 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 1073741824 Jul 22 20:55:16 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:16 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-df4afee6-1113-426c-9a38-5b23c5196ab5 tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:55:17 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 1073741824" returned: 0 in 0.414s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:17 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 Jul 22 20:55:17 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:17 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35" returned: 0 in 0.250s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.501s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454324252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc257f18-3a13-4e66-82f0-859d572b066c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb18c917e6634bce9492447f7cbd0332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:15Z,use_quota=True,user_id='fe0cd2b5b528490caa2d765b06c0c4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Creating volume dc257f18-3a13-4e66-82f0-859d572b066c {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:17 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:17 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c 1073741824 Jul 22 20:55:17 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0757eb-d16a-43aa-8a5b-f77a15b0d2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1e2c7a-d197-4318-8af7-4685cf3def35', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614b64ff-41f2-4b43-b5d8-dd4487362aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:17 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Volume volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 (9c1e2c7a-d197-4318-8af7-4685cf3def35): created successfully Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614b64ff-41f2-4b43-b5d8-dd4487362aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (734619a6-2854-4a34-9c60-828f8f1bc8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:17 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8b411e1e-4977-483c-b51f-af63759c0aef tempest-ProjectReaderTests-134062537 None] Created volume successfully. Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-e2ba2fed-582f-4c9b-b297-ae86ed743397-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-e2ba2fed-582f-4c9b-b297-ae86ed743397-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-118ba107-89c5-437d-a3a2-1ab9ea707b70" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-118ba107-89c5-437d-a3a2-1ab9ea707b70" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-e2ba2fed-582f-4c9b-b297-ae86ed743397" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-e2ba2fed-582f-4c9b-b297-ae86ed743397" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot e2ba2fed-582f-4c9b-b297-ae86ed743397 of volume 118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed266ffb-62f3-4158-99f3-c1fffce667f5]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:17 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:18 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 Jul 22 20:55:18 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:18 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c 1073741824" returned: 0 in 0.486s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:18 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c Jul 22 20:55:18 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:18 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397" returned: 0 in 0.390s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-118ba107-89c5-437d-a3a2-1ab9ea707b70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b75ec6-fe14-45a0-81f2-a3779b0a42fc]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:18 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c" returned: 0 in 0.255s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.567s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-quobyte-add0741e-8ed3-413f-82b4-0710739bfb76-84f65aee-7688-4198-8962-3e9fee2ba3ea" by "_create_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f11736-d97b-4f72-a09c-b41ce6533e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc257f18-3a13-4e66-82f0-859d572b066c', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65417539-fa43-4cc4-abc8-9ff88f992081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-add0741e-8ed3-413f-82b4-0710739bfb76-84f65aee-7688-4198-8962-3e9fee2ba3ea" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Creating volume 84f65aee-7688-4198-8962-3e9fee2ba3ea from snapshot add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:18 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 Jul 22 20:55:18 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-quobyte-84f65aee-7688-4198-8962-3e9fee2ba3ea" by "_copy_volume_from_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:18 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Volume volume-dc257f18-3a13-4e66-82f0-859d572b066c (dc257f18-3a13-4e66-82f0-859d572b066c): created successfully Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65417539-fa43-4cc4-abc8-9ff88f992081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Flow 'volume_create_manager' (4f62c2ac-d160-49f9-9bca-cbc22b72617d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-84f65aee-7688-4198-8962-3e9fee2ba3ea" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] snapshot: add0741e-8ed3-413f-82b4-0710739bfb76, volume: 84f65aee-7688-4198-8962-3e9fee2ba3ea, {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 20:55:18 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9ae546c5-6ceb-4401-a3c4-1e04d0ef7381 tempest-ProjectReaderTests-1881297244 None] Created volume successfully. Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f04c38-dbf6-4fb9-a3df-b9fd3e48b401]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:18 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 Jul 22 20:55:18 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:18 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70" returned: 0 in 0.451s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:18 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 Jul 22 20:55:18 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:18 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76" returned: 0 in 0.403s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb45953-349b-4579-8229-239a87fcaf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Creating direct copy from snapshot {{(pid=87818) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf2044-5389-4872-a414-1537ed352fd4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:18 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:19 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 Jul 22 20:55:19 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:19 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397" returned: 0 in 0.361s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:19 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397 Jul 22 20:55:19 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Acquiring lock "cinder-dc257f18-3a13-4e66-82f0-859d572b066c-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Lock "cinder-dc257f18-3a13-4e66-82f0-859d572b066c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:19 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15" returned: 0 in 0.441s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.utils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Path /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea not found in is_blk_device check {{(pid=87818) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:19 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70.e2ba2fed-582f-4c9b-b297-ae86ed743397" returned: 0 in 0.314s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:19 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea Jul 22 20:55:19 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Acquiring lock "cinder-quobyte-dc257f18-3a13-4e66-82f0-859d572b066c" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-e2ba2fed-582f-4c9b-b297-ae86ed743397" released by "_delete_snapshot" :: held 1.611s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-118ba107-89c5-437d-a3a2-1ab9ea707b70" released by "delete_snapshot" :: held 1.634s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Lock "cinder-quobyte-dc257f18-3a13-4e66-82f0-859d572b066c" acquired by "delete_volume" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[05703f80-ea26-4170-ac02-bdb307d1f540]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Created reservations ['97165839-2874-4099-a174-b44065849485', 'd5e67661-f2a7-42db-9b29-50e47c2f7ec4', '8a4848d7-3639-4eec-baa8-6cd8982bd9af', '59922f93-4291-489b-84f1-3e392ddffa18'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:19 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-e8cebb0d-4cf4-477c-b1a0-d0b7971acf97 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-e2ba2fed-582f-4c9b-b297-ae86ed743397-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:19 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c Jul 22 20:55:19 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:19 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c" returned: 0 in 0.382s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:19 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:19 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c Jul 22 20:55:19 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-118ba107-89c5-437d-a3a2-1ab9ea707b70-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-118ba107-89c5-437d-a3a2-1ab9ea707b70-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-118ba107-89c5-437d-a3a2-1ab9ea707b70" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-118ba107-89c5-437d-a3a2-1ab9ea707b70" acquired by "delete_volume" :: waited 0.030s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c5aef-8034-4248-a41d-6c62b28578ec]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:20 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 Jul 22 20:55:20 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:20 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-dc257f18-3a13-4e66-82f0-859d572b066c" returned: 0 in 0.871s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Lock "cinder-quobyte-dc257f18-3a13-4e66-82f0-859d572b066c" released by "delete_volume" :: held 1.325s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:20 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Created reservations ['8540858c-7d0a-404c-979a-e320bce08c90', '42cddc42-ac3d-4267-b53d-08bc276cee94', '5cc25100-7c96-4c69-a7d7-eb658575e62d', '7cb19410-aa94-458f-98e7-3e551b05af75'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:21 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70" returned: 0 in 0.840s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:21 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70 Jul 22 20:55:21 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:21 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:21 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:21 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.490s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:21 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Deleted volume successfully. Jul 22 20:55:21 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-118ba107-89c5-437d-a3a2-1ab9ea707b70" returned: 0 in 0.660s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-118ba107-89c5-437d-a3a2-1ab9ea707b70" released by "delete_volume" :: held 1.657s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:21 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-d405c0d0-650b-4893-87c1-4dfbd591965c tempest-ProjectReaderTests-1881297244 None] Lock "cinder-dc257f18-3a13-4e66-82f0-859d572b066c-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:22 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Created reservations ['28a37cf1-f28f-4cd2-89dc-d0b73ba6cc76', '6d4de717-d2a4-4a8b-afa9-6a149d3c5ac3', 'e9452d64-b56a-42b6-8f65-58ea5c1cbe51', '46d6a73a-3655-4b3c-a8f5-02e31eef1903'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:22 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:22 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:22 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:22 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:23 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.979s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:23 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-7fbddc96-359d-4722-9a0c-2ddf17ce0302 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-118ba107-89c5-437d-a3a2-1ab9ea707b70-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Flow 'volume_create_manager' (be6982f7-4496-4804-87d8-c1606a388cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce988034-ac0a-42c9-83e5-f643738b0b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce988034-ac0a-42c9-83e5-f643738b0b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510060483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d58073-fe04-494a-bc5f-44544637a97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb18c917e6634bce9492447f7cbd0332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:23Z,use_quota=True,user_id='fe0cd2b5b528490caa2d765b06c0c4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd9abbb-6b9b-4909-84a3-cc779c964613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd9abbb-6b9b-4909-84a3-cc779c964613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e509c-d6ae-4dcf-9a00-dc434bb76516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e509c-d6ae-4dcf-9a00-dc434bb76516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d58073-fe04-494a-bc5f-44544637a97b', 'volume_name': 'volume-43d58073-fe04-494a-bc5f-44544637a97b', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1865e309-5fa1-45bd-b7d1-204f508ccaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1865e309-5fa1-45bd-b7d1-204f508ccaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1459b4f1-4bc6-484a-bee1-d8334f177bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:23 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Volume 43d58073-fe04-494a-bc5f-44544637a97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d58073-fe04-494a-bc5f-44544637a97b', 'volume_size': 1} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (84139105-4799-4bd2-bcde-fa49d2304bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6686b2e9-a591-43b1-a2e4-bd15a023c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6686b2e9-a591-43b1-a2e4-bd15a023c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235000178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9817197-3fec-4156-8b3e-33bfc9a86aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:24Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e458c748-a62c-4709-a590-6a4ccdcae4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:23 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e458c748-a62c-4709-a590-6a4ccdcae4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd06170-2f4d-4d6b-8dd3-a0d926d13a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd06170-2f4d-4d6b-8dd3-a0d926d13a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9817197-3fec-4156-8b3e-33bfc9a86aed', 'volume_name': 'volume-b9817197-3fec-4156-8b3e-33bfc9a86aed', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a220cbc6-fe50-4454-8f8a-a6739ba056f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a220cbc6-fe50-4454-8f8a-a6739ba056f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c977ea7-7844-4db3-b098-b014cfc70ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:24 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Volume b9817197-3fec-4156-8b3e-33bfc9a86aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9817197-3fec-4156-8b3e-33bfc9a86aed', 'volume_size': 1} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:24 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea" returned: 0 in 5.302s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e45465-3bf4-423f-a675-fdf5bf01ae40]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:24 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:24 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 Jul 22 20:55:24 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:25 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15" returned: 0 in 0.517s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.image.image_utils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Image conversion details: src /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea {{(pid=87818) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 20:55:25 devstack cinder-volume[87818]: INFO cinder.image.image_utils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Converted 1024.00 MB image at 193.09 MB/s Jul 22 20:55:25 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea is being set with open permissions: ugo+rw Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:25 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea Jul 22 20:55:25 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:25 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea" returned: 0 in 0.242s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-84f65aee-7688-4198-8962-3e9fee2ba3ea" released by "_copy_volume_from_snapshot" :: held 7.028s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-add0741e-8ed3-413f-82b4-0710739bfb76-84f65aee-7688-4198-8962-3e9fee2ba3ea" released by "_create_volume_from_snapshot" :: held 7.092s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.128s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.818s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Creating offline snapshot 24b872d1-9539-4d22-9627-e1af0efde1a2 of volume 9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078f2c1d-ce71-4b38-a365-d86d13156947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f65aee-7688-4198-8962-3e9fee2ba3ea', 'volume_size': 1, 'snapshot_id': 'add0741e-8ed3-413f-82b4-0710739bfb76'}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1eaf4e-ba07-4d50-9630-b921182fd4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1a6fad-afb0-476e-a332-d31f93ade73f]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:25 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Volume volume-84f65aee-7688-4198-8962-3e9fee2ba3ea (84f65aee-7688-4198-8962-3e9fee2ba3ea): created successfully Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1eaf4e-ba07-4d50-9630-b921182fd4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Flow 'volume_create_manager' (7ec787e3-8f6f-4678-9c94-89b72ba9ae3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:25 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c108edcd-656c-4c26-827d-6fa1f1df6fc2 tempest-SnapshotDependencyTests-1637006147 None] Created volume successfully. Jul 22 20:55:25 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 Jul 22 20:55:25 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:25 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:25 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:25 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 1G Jul 22 20:55:25 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:26 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 1G" returned: 0 in 0.393s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:26 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 Jul 22 20:55:26 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:26 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:26 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 is being set with open permissions: ugo+rw Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:26 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 Jul 22 20:55:26 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-add0741e-8ed3-413f-82b4-0710739bfb76-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-add0741e-8ed3-413f-82b4-0710739bfb76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-quobyte-5fb45953-349b-4579-8229-239a87fcaf15" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-5fb45953-349b-4579-8229-239a87fcaf15" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-quobyte-add0741e-8ed3-413f-82b4-0710739bfb76" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-add0741e-8ed3-413f-82b4-0710739bfb76" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Deleting offline snapshot add0741e-8ed3-413f-82b4-0710739bfb76 of volume 5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] snapshot_file for this snap is: volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220cab1-c561-4c28-872c-e01269418648]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:26 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2" returned: 0 in 0.258s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:26 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:26 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.info Jul 22 20:55:26 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:26 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 Jul 22 20:55:26 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:27 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.info" returned: 0 in 0.265s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:27 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.info is being set with open permissions: ugo+rw Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:27 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.info Jul 22 20:55:27 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:27 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76" returned: 0 in 0.382s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb45953-349b-4579-8229-239a87fcaf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c9e024-f364-4870-9028-61382588331d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:27 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 Jul 22 20:55:27 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:27 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.info" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.839s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510060483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d58073-fe04-494a-bc5f-44544637a97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb18c917e6634bce9492447f7cbd0332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:23Z,use_quota=True,user_id='fe0cd2b5b528490caa2d765b06c0c4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Creating volume 43d58073-fe04-494a-bc5f-44544637a97b {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:27 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:27 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b 1073741824 Jul 22 20:55:27 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:27 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9ac5a204-53b9-427b-a5c9-1dba5aa611ca tempest-ProjectReaderTests-134062537 None] Create snapshot completed successfully Jul 22 20:55:27 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15" returned: 0 in 0.403s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:27 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 Jul 22 20:55:27 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:27 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b 1073741824" returned: 0 in 0.467s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:27 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:27 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b Jul 22 20:55:27 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:28 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76" returned: 0 in 0.385s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:28 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76 Jul 22 20:55:28 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:28 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b" returned: 0 in 0.263s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.183s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235000178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9817197-3fec-4156-8b3e-33bfc9a86aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:24Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Creating volume b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:28 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1459b4f1-4bc6-484a-bee1-d8334f177bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d58073-fe04-494a-bc5f-44544637a97b', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:28 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed 1073741824 Jul 22 20:55:28 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e05fc3-a83c-4016-bc99-69d2ec173abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:28 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Volume volume-43d58073-fe04-494a-bc5f-44544637a97b (43d58073-fe04-494a-bc5f-44544637a97b): created successfully Jul 22 20:55:28 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e05fc3-a83c-4016-bc99-69d2ec173abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Flow 'volume_create_manager' (be6982f7-4496-4804-87d8-c1606a388cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15.add0741e-8ed3-413f-82b4-0710739bfb76" returned: 0 in 0.273s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-249a78f5-a1d3-49e1-85b8-3bb1b6922811 tempest-ProjectReaderTests-1881297244 None] Created volume successfully. Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-add0741e-8ed3-413f-82b4-0710739bfb76" released by "_delete_snapshot" :: held 1.554s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-5fb45953-349b-4579-8229-239a87fcaf15" released by "delete_snapshot" :: held 1.585s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Created reservations ['55f932d0-482d-4bc4-a21e-c6d45c2aa1e0', 'efdd9718-bb94-4222-8fd9-7dc9fe0e699c', '1270b1a9-5038-4c6d-bd66-639f2e0a232d', 'dd384eae-c6a5-4c25-a13f-3ee904fdcb94'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-24b872d1-9539-4d22-9627-e1af0efde1a2-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Lock "cinder-24b872d1-9539-4d22-9627-e1af0efde1a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-9c1e2c7a-d197-4318-8af7-4685cf3def35" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:28 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Delete snapshot completed successfully. Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-9c1e2c7a-d197-4318-8af7-4685cf3def35" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-24b872d1-9539-4d22-9627-e1af0efde1a2" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-19cbcdf2-aa81-4fe7-94c2-dba3b0b6062f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-add0741e-8ed3-413f-82b4-0710739bfb76-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-24b872d1-9539-4d22-9627-e1af0efde1a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Deleting offline snapshot 24b872d1-9539-4d22-9627-e1af0efde1a2 of volume 9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] snapshot_file for this snap is: volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f64925-47f1-4f8e-9acb-514c68c4f8cb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:28 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 Jul 22 20:55:28 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:28 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed 1073741824" returned: 0 in 0.482s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:28 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed Jul 22 20:55:28 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-5fb45953-349b-4579-8229-239a87fcaf15-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:28 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-5fb45953-349b-4579-8229-239a87fcaf15-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-quobyte-5fb45953-349b-4579-8229-239a87fcaf15" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-5fb45953-349b-4579-8229-239a87fcaf15" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:29 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:29 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed" returned: 0 in 0.301s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2" returned: 0 in 0.480s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c1e2c7a-d197-4318-8af7-4685cf3def35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[84406d2a-5e48-409a-96ba-786ad177ffef]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[af558eef-f10f-49d0-97e7-8a6fe0f510eb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c977ea7-7844-4db3-b098-b014cfc70ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9817197-3fec-4156-8b3e-33bfc9a86aed', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48591cac-2d87-42bd-83eb-367f9687c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:29 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Volume volume-b9817197-3fec-4156-8b3e-33bfc9a86aed (b9817197-3fec-4156-8b3e-33bfc9a86aed): created successfully Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48591cac-2d87-42bd-83eb-367f9687c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (84139105-4799-4bd2-bcde-fa49d2304bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:29 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5b0fddaa-ff9c-473c-bc78-7e0f313ca72e tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:55:29 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 Jul 22 20:55:29 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:29 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 Jul 22 20:55:29 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Acquiring lock "cinder-43d58073-fe04-494a-bc5f-44544637a97b-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Lock "cinder-43d58073-fe04-494a-bc5f-44544637a97b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Acquiring lock "cinder-quobyte-43d58073-fe04-494a-bc5f-44544637a97b" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Lock "cinder-quobyte-43d58073-fe04-494a-bc5f-44544637a97b" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaa424d-f7e0-4bd0-ac90-979b191c83b4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15" returned: 0 in 0.421s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:29 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35" returned: 0 in 0.430s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15 Jul 22 20:55:29 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:29 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 Jul 22 20:55:29 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:29 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b Jul 22 20:55:29 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:29 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-5fb45953-349b-4579-8229-239a87fcaf15" returned: 0 in 0.272s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-5fb45953-349b-4579-8229-239a87fcaf15" released by "delete_volume" :: held 0.778s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Created reservations ['9b8171c6-6be8-4a79-b086-db6b1ac8937c', 'c17fcc50-794e-469c-b311-d7e265ccb805', '0d075bb3-d6f6-432e-9a29-27e01976cb77', '6812c0eb-cabc-401a-b571-009b8e438b29'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:29 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b" returned: 0 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:29 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b Jul 22 20:55:29 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2" returned: 0 in 0.422s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:29 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:29 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:29 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:29 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2 Jul 22 20:55:29 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-84f65aee-7688-4198-8962-3e9fee2ba3ea-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-84f65aee-7688-4198-8962-3e9fee2ba3ea-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:30 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-43d58073-fe04-494a-bc5f-44544637a97b" returned: 0 in 0.299s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Lock "cinder-quobyte-43d58073-fe04-494a-bc5f-44544637a97b" released by "delete_volume" :: held 0.773s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:30 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "cinder-quobyte-84f65aee-7688-4198-8962-3e9fee2ba3ea" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.332s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Deleted volume successfully. Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-84f65aee-7688-4198-8962-3e9fee2ba3ea" acquired by "delete_volume" :: waited 0.031s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:30 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35.24b872d1-9539-4d22-9627-e1af0efde1a2" returned: 0 in 0.381s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95ad6b-2e6e-4aa8-9e3c-5950c8abf6bd]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-4aebc1b7-3ebc-4ed3-ba28-82379e0e6ae1 tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-5fb45953-349b-4579-8229-239a87fcaf15-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-24b872d1-9539-4d22-9627-e1af0efde1a2" released by "_delete_snapshot" :: held 1.861s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-9c1e2c7a-d197-4318-8af7-4685cf3def35" released by "delete_snapshot" :: held 1.896s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Created reservations ['eab2134f-d7b9-4305-b448-1374d9bd9f18', '71dbc508-9c5f-4c67-8572-60dbdba3e88e', 'b42e5120-b3ef-47ab-8b13-289e91463c3c', 'ece14416-7749-4586-987d-7992911f7a6b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot 1ace43ac-d66e-40c4-8e78-f4957e05e2a1 of volume b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101512e-6515-4b44-9fd1-f61313c2f99c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:30 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea Jul 22 20:55:30 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Created reservations ['5e3ff08d-891b-4093-87bd-2775a996c10d', 'c3186816-316d-42df-859b-24dbdca82aca', 'dd9ae82f-50c6-4efc-b243-e5a7ad26bdc1', '95c6ab06-a71d-47cb-8380-af104aa0b55c'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:30 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:30 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:30 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed Jul 22 20:55:30 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:30 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Delete snapshot completed successfully. Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-947bfcfe-fa8a-4fbc-a916-7508ebc84405 tempest-ProjectReaderTests-134062537 None] Lock "cinder-24b872d1-9539-4d22-9627-e1af0efde1a2-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:30 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea" returned: 0 in 0.547s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:30 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:30 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.428s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:30 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:30 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Deleted volume successfully. Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bc27f74b-4205-45a5-8f26-6031bf47d628 tempest-ProjectReaderTests-1881297244 None] Lock "cinder-43d58073-fe04-494a-bc5f-44544637a97b-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:31 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed" returned: 0 in 0.602s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:31 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 1G Jul 22 20:55:31 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:31 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-84f65aee-7688-4198-8962-3e9fee2ba3ea" returned: 0 in 0.369s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-quobyte-84f65aee-7688-4198-8962-3e9fee2ba3ea" released by "delete_volume" :: held 1.003s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Created reservations ['8b6047e0-62d4-4112-ad4b-f4748aa103ec', '5468b151-07a9-42c7-b24e-087e2a0cee3d', '7df841c8-3056-4132-bfef-a4701d4221ae', '9f7a89f6-ab7f-46f5-9d51-aa005d7583f7'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:31 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:31 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:31 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 1G" returned: 0 in 0.523s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9817197-3fec-4156-8b3e-33bfc9a86aed -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:31 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9817197-3fec-4156-8b3e-33bfc9a86aed -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 Jul 22 20:55:31 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-9c1e2c7a-d197-4318-8af7-4685cf3def35-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-9c1e2c7a-d197-4318-8af7-4685cf3def35-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:31 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-9c1e2c7a-d197-4318-8af7-4685cf3def35" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.361s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:31 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Deleted volume successfully. Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-9c1e2c7a-d197-4318-8af7-4685cf3def35" acquired by "delete_volume" :: waited 0.033s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-249a0a5f-ffcd-4e23-8875-f01838929e1f tempest-SnapshotDependencyTests-1637006147 None] Lock "cinder-84f65aee-7688-4198-8962-3e9fee2ba3ea-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[835142a4-62c9-40a8-a20b-00e4bddac0e3]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:31 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:32 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 Jul 22 20:55:32 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:32 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9817197-3fec-4156-8b3e-33bfc9a86aed -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1" returned: 0 in 0.416s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:32 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 is being set with open permissions: ugo+rw Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:32 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 Jul 22 20:55:32 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:32 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35" returned: 0 in 0.397s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:32 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35 Jul 22 20:55:32 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:32 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1" returned: 0 in 0.271s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:32 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.info Jul 22 20:55:32 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:32 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-9c1e2c7a-d197-4318-8af7-4685cf3def35" returned: 0 in 0.292s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-9c1e2c7a-d197-4318-8af7-4685cf3def35" released by "delete_volume" :: held 0.766s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Created reservations ['ade2c98b-df45-4d2e-9057-12a3782db235', '1f3ca292-8a10-4480-8e65-5538cb926294', '708adec2-fdb9-447b-8871-b86a22e17946', 'f530e9f8-1f8e-42b3-a24e-05b391536555'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:32 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.info" returned: 0 in 0.368s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:32 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.info is being set with open permissions: ugo+rw Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:32 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.info Jul 22 20:55:32 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:32 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:32 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:32 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:33 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.info" returned: 0 in 0.388s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:33 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6f27c265-f4f1-4eca-941a-b207efaa343c tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:55:33 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.410s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:33 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Deleted volume successfully. Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-ec15af2d-be27-4708-9f03-2523f5be73c2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-9c1e2c7a-d197-4318-8af7-4685cf3def35-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (bf086b5c-d9f4-4575-a794-b855e1f37911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a64a527-cd05-41ad-a46e-58851d5ab1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a64a527-cd05-41ad-a46e-58851d5ab1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223480353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9f8038-4201-4a99-8655-42e846473562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:33Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee76ebcb-23ce-4205-821f-069d775c0ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee76ebcb-23ce-4205-821f-069d775c0ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31d9fff-688f-4b62-bada-7379708ab0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31d9fff-688f-4b62-bada-7379708ab0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9f8038-4201-4a99-8655-42e846473562', 'volume_name': 'volume-eb9f8038-4201-4a99-8655-42e846473562', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ecc0d2-7a54-4e3a-b7c0-0d65d210d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ecc0d2-7a54-4e3a-b7c0-0d65d210d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5964c0-228c-4c9f-8361-5dfa21537cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:33 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Volume eb9f8038-4201-4a99-8655-42e846473562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9f8038-4201-4a99-8655-42e846473562', 'volume_size': 1} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223480353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9f8038-4201-4a99-8655-42e846473562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:33Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Creating volume eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:33 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-1ace43ac-d66e-40c4-8e78-f4957e05e2a1-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:33 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 1073741824 Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-1ace43ac-d66e-40c4-8e78-f4957e05e2a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:33 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-b9817197-3fec-4156-8b3e-33bfc9a86aed" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-b9817197-3fec-4156-8b3e-33bfc9a86aed" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-1ace43ac-d66e-40c4-8e78-f4957e05e2a1" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-1ace43ac-d66e-40c4-8e78-f4957e05e2a1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot 1ace43ac-d66e-40c4-8e78-f4957e05e2a1 of volume b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f446b9e6-2656-42bd-b6de-b919a2a36ecf]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:33 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:33 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 Jul 22 20:55:33 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:34 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 1073741824" returned: 0 in 0.533s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:34 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1" returned: 0 in 0.449s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9817197-3fec-4156-8b3e-33bfc9a86aed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:34 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 Jul 22 20:55:34 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f739f5b0-2663-4283-a339-1659cf023525]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:34 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed Jul 22 20:55:34 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:34 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562" returned: 0 in 0.389s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5964c0-228c-4c9f-8361-5dfa21537cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9f8038-4201-4a99-8655-42e846473562', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e22836-29e1-445b-8831-4d6f4bb4fd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:34 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Volume volume-eb9f8038-4201-4a99-8655-42e846473562 (eb9f8038-4201-4a99-8655-42e846473562): created successfully Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e22836-29e1-445b-8831-4d6f4bb4fd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (bf086b5c-d9f4-4575-a794-b855e1f37911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:34 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-79d40e54-6814-4bb6-ab58-d8bd25f5233d tempest-ProjectReaderTests-134062537 None] Created volume successfully. Jul 22 20:55:34 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed" returned: 0 in 0.487s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:34 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:34 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 Jul 22 20:55:34 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:35 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1" returned: 0 in 0.377s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:35 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1 Jul 22 20:55:35 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:35 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed.1ace43ac-d66e-40c4-8e78-f4957e05e2a1" returned: 0 in 0.336s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-1ace43ac-d66e-40c4-8e78-f4957e05e2a1" released by "_delete_snapshot" :: held 1.810s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-b9817197-3fec-4156-8b3e-33bfc9a86aed" released by "delete_snapshot" :: held 1.850s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Created reservations ['4dd2f5d0-119e-4434-a401-3c0976a72b42', '9899d7f0-4fab-48c5-b82c-0be206b32944', 'c3c78d3a-5a90-4ad8-9271-be6a53b9cda7', 'e74f8fd8-6b27-4da6-9165-f275c2fb9007'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:35 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-f91b2961-5d2c-4ede-83ff-b6af1e485435 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-1ace43ac-d66e-40c4-8e78-f4957e05e2a1-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Creating offline snapshot c747aafa-1a2f-47da-b868-1edcceaf96ef of volume eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a026d1d-4aae-4f8f-ad13-682982b6ad55]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:35 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-b9817197-3fec-4156-8b3e-33bfc9a86aed-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-b9817197-3fec-4156-8b3e-33bfc9a86aed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-b9817197-3fec-4156-8b3e-33bfc9a86aed" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-b9817197-3fec-4156-8b3e-33bfc9a86aed" acquired by "delete_volume" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:36 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 Jul 22 20:55:36 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabc02f-9908-4391-b768-6d7fd5282525]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:36 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed Jul 22 20:55:36 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:36 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562" returned: 0 in 0.545s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:36 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef 1G Jul 22 20:55:36 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:36 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed" returned: 0 in 0.484s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:36 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed Jul 22 20:55:36 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:36 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:36 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-b9817197-3fec-4156-8b3e-33bfc9a86aed" returned: 0 in 0.327s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-b9817197-3fec-4156-8b3e-33bfc9a86aed" released by "delete_volume" :: held 0.918s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:37 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef 1G" returned: 0 in 0.588s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9f8038-4201-4a99-8655-42e846473562 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Created reservations ['f6d44207-f429-46a5-ab78-4c34c0535ca2', 'd91f2153-fb93-44e7-983d-d0c16d1ced1b', 'ff24645b-b9d9-4b17-ad14-b953bbd7afd8', '6b4d54af-477b-41a3-b9b2-9720d593161b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:37 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9f8038-4201-4a99-8655-42e846473562 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef Jul 22 20:55:37 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:37 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:37 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:37 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9f8038-4201-4a99-8655-42e846473562 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef" returned: 0 in 0.427s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:37 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef is being set with open permissions: ugo+rw Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:37 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef Jul 22 20:55:37 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:37 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.363s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:37 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-25caab02-e3b1-43f1-b9b1-5cc825aba52a tempest-ProjectMemberTests-1773716304 None] Lock "cinder-b9817197-3fec-4156-8b3e-33bfc9a86aed-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:37 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef" returned: 0 in 0.347s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:37 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:37 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.info Jul 22 20:55:37 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:38 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.info" returned: 0 in 0.375s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:38 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.info is being set with open permissions: ugo+rw Jul 22 20:55:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:38 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.info Jul 22 20:55:38 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:38 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.info" returned: 0 in 0.331s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:38 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:38 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6ce92aaa-ae6d-4db0-a875-237a77bf829f tempest-ProjectReaderTests-134062537 None] Create snapshot completed successfully Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (605ccd8c-f4ca-4d79-b1ce-29e424ae041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468fd607-4884-4500-88d4-6c1863377ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-c747aafa-1a2f-47da-b868-1edcceaf96ef-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468fd607-4884-4500-88d4-6c1863377ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217100591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ccc3f1-6ef7-4175-9961-f2b9a486cf27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:39Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26615baa-7246-4479-8ee9-1db5b08000cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26615baa-7246-4479-8ee9-1db5b08000cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa324864-543b-4e7d-b2ab-066cbe5d5bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa324864-543b-4e7d-b2ab-066cbe5d5bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ccc3f1-6ef7-4175-9961-f2b9a486cf27', 'volume_name': 'volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d65427-5e5f-44b5-b212-1b76e1a03092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d65427-5e5f-44b5-b212-1b76e1a03092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bcbced-48cc-4005-98ae-56c547d28161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:39 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Volume f5ccc3f1-6ef7-4175-9961-f2b9a486cf27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27', 'volume_size': 1} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217100591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ccc3f1-6ef7-4175-9961-f2b9a486cf27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:39Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Creating volume f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:39 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Lock "cinder-c747aafa-1a2f-47da-b868-1edcceaf96ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-eb9f8038-4201-4a99-8655-42e846473562" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-eb9f8038-4201-4a99-8655-42e846473562" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-c747aafa-1a2f-47da-b868-1edcceaf96ef" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:39 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 1073741824 Jul 22 20:55:39 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-c747aafa-1a2f-47da-b868-1edcceaf96ef" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Deleting offline snapshot c747aafa-1a2f-47da-b868-1edcceaf96ef of volume eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] snapshot_file for this snap is: volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c14b7-2a4d-49dc-a6e6-c6439baae945]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:39 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef Jul 22 20:55:39 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:39 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 1073741824" returned: 0 in 0.612s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:39 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef" returned: 0 in 0.557s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:39 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9f8038-4201-4a99-8655-42e846473562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:39 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 Jul 22 20:55:39 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94abe92-2091-4912-871a-dcb7f5411bf4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:40 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 Jul 22 20:55:40 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:40 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" returned: 0 in 0.336s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bcbced-48cc-4005-98ae-56c547d28161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f538ed-788b-47ba-b8e5-dd6945f67a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:40 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Volume volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 (f5ccc3f1-6ef7-4175-9961-f2b9a486cf27): created successfully Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f538ed-788b-47ba-b8e5-dd6945f67a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (605ccd8c-f4ca-4d79-b1ce-29e424ae041f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:40 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-51165ff2-3310-4ad3-a972-67af47219cc0 tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:55:40 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562" returned: 0 in 0.480s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:40 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef Jul 22 20:55:40 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:40 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef" returned: 0 in 0.398s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:40 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:40 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef Jul 22 20:55:40 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:41 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562.c747aafa-1a2f-47da-b868-1edcceaf96ef" returned: 0 in 0.294s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-c747aafa-1a2f-47da-b868-1edcceaf96ef" released by "_delete_snapshot" :: held 1.892s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-eb9f8038-4201-4a99-8655-42e846473562" released by "delete_snapshot" :: held 1.931s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:41 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:41 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot dba33c99-5db4-4dd6-a74d-234f53b5929d of volume f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Created reservations ['bbfcf668-6ead-48a5-ae35-8a5a14967847', '9063d328-ce52-4d27-8ad5-1a29d48dac55', '2d69f676-313d-4e15-b8f6-4f8cdf07e8ea', '9abf09c8-928c-4897-837a-f9144bd7679f'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[52330060-30d9-4c92-a3ed-756e2bf265aa]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:41 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 Jul 22 20:55:41 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:41 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Delete snapshot completed successfully. Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-3fd83430-37bf-47da-be96-de149e520848 tempest-ProjectReaderTests-134062537 None] Lock "cinder-c747aafa-1a2f-47da-b868-1edcceaf96ef-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:41 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.446s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_service.periodic_task [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] Running periodic task VolumeManager._thread_info {{(pid=87818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread count: 28 {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-a5cb74fe-8cb2-4cba-be68-2de4566c4655 None None] thread info: [<_MainThread(MainThread, started 129194313339008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 20:55:41 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" returned: 0 in 0.477s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:41 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:41 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d 1G Jul 22 20:55:41 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:42 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-eb9f8038-4201-4a99-8655-42e846473562-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d 1G" returned: 0 in 0.557s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Lock "cinder-eb9f8038-4201-4a99-8655-42e846473562-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:42 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d Jul 22 20:55:42 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-eb9f8038-4201-4a99-8655-42e846473562" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-eb9f8038-4201-4a99-8655-42e846473562" acquired by "delete_volume" :: waited 0.037s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db81b80-a102-4e8e-b3c2-fb22352a4f92]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:42 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 Jul 22 20:55:42 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:42 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d" returned: 0 in 0.469s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:42 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d is being set with open permissions: ugo+rw Jul 22 20:55:42 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:43 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d Jul 22 20:55:43 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:43 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562" returned: 0 in 0.435s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:43 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562 Jul 22 20:55:43 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:43 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d" returned: 0 in 0.311s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:43 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.info Jul 22 20:55:43 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:43 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-eb9f8038-4201-4a99-8655-42e846473562" returned: 0 in 0.353s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-eb9f8038-4201-4a99-8655-42e846473562" released by "delete_volume" :: held 0.903s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:43 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.info" returned: 0 in 0.344s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:43 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.info is being set with open permissions: ugo+rw Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:43 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.info Jul 22 20:55:43 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Created reservations ['136d3479-fe7c-4863-b6f7-a66389d2902a', '3816d283-6b34-412a-92cd-761ee431a2ee', 'e91ccc90-3ccf-49b8-bb30-7c90f64c1ac3', '9438d3eb-666b-48bd-8205-dd38f379906b'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:43 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:43 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:43 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:44 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.info" returned: 0 in 0.371s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.688s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-df18d8b9-7b25-4457-a7e3-01a9e7fb0593 tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:55:44 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.290s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:44 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Deleted volume successfully. Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-a8abb390-7885-4db1-b3a1-32b02309b297 tempest-ProjectReaderTests-134062537 None] Lock "cinder-eb9f8038-4201-4a99-8655-42e846473562-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-dba33c99-5db4-4dd6-a74d-234f53b5929d-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-dba33c99-5db4-4dd6-a74d-234f53b5929d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-dba33c99-5db4-4dd6-a74d-234f53b5929d" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-dba33c99-5db4-4dd6-a74d-234f53b5929d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot dba33c99-5db4-4dd6-a74d-234f53b5929d of volume f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[66117fae-0543-4841-919e-8d75c6abc1e6]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:44 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:44 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d Jul 22 20:55:44 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:45 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d" returned: 0 in 0.482s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb04ffa4-9962-476b-b187-0828bae3a198]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:45 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 Jul 22 20:55:45 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (1dc32ef9-7bee-478a-aa27-4c081f97fb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b2f4d-804e-439e-b516-65fee003fb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b2f4d-804e-439e-b516-65fee003fb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746577834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:46Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8727819a-1da2-48b5-abde-71203bc8ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8727819a-1da2-48b5-abde-71203bc8ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6914f815-b58d-4ef4-a54f-a77fc9f10fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6914f815-b58d-4ef4-a54f-a77fc9f10fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef', 'volume_name': 'volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f4fe53-6d69-40a8-9644-0961bef711eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f4fe53-6d69-40a8-9644-0961bef711eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e40de4-6bbb-4c29-ab1a-3ce7e3a906d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:45 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Volume e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef', 'volume_size': 1} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746577834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6b9b02f69a4f45b732cdb1151f45f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:46Z,use_quota=True,user_id='ad6efa8a6b8d424a8dc010f996b79537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Creating volume e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:45 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:45 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" returned: 0 in 0.428s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:45 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:45 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef 1073741824 Jul 22 20:55:45 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:45 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d Jul 22 20:55:45 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:46 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d" returned: 0 in 0.370s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:46 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d Jul 22 20:55:46 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:46 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef 1073741824" returned: 0 in 0.457s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:46 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef Jul 22 20:55:46 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:46 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27.dba33c99-5db4-4dd6-a74d-234f53b5929d" returned: 0 in 0.265s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-dba33c99-5db4-4dd6-a74d-234f53b5929d" released by "_delete_snapshot" :: held 1.682s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" released by "delete_snapshot" :: held 1.714s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Created reservations ['b7dc8fce-314f-4850-bdac-48c29ca17a15', 'bc6a92b2-5152-488e-a7ed-6168a18a6ad3', 'd0aafcc7-f7e3-4a6e-acb8-e1aa1ffaf003', '63a6814d-9a5a-410d-b755-f7634b1726f6'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:46 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" returned: 0 in 0.275s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e40de4-6bbb-4c29-ab1a-3ce7e3a906d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2618bbf8-2d01-4b0d-b2a5-5278d1702cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:46 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Volume volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef (e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef): created successfully Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2618bbf8-2d01-4b0d-b2a5-5278d1702cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Flow 'volume_create_manager' (1dc32ef9-7bee-478a-aa27-4c081f97fb9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:46 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-5007efb9-ef33-41f5-83e8-02b79099ae75 tempest-ProjectReaderTests-134062537 None] Created volume successfully. Jul 22 20:55:46 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-9b91c8a2-f1d9-420b-ae48-d07068ff61f3 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-dba33c99-5db4-4dd6-a74d-234f53b5929d-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748fe38-ee1e-4076-83c1-0bdb2ac8edde]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:46 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:47 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 Jul 22 20:55:47 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:47 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" returned: 0 in 0.352s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:47 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27 Jul 22 20:55:47 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:47 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" returned: 0 in 0.253s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27" released by "delete_volume" :: held 0.663s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=170,cinder:UPDATE=205,cinder:INSERT=58,cinder:DELETE=17 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Created reservations ['230c3377-d4af-41f2-bd31-bd5cdfd65659', '28169f7b-70ea-4b95-a4c7-d86d3c2e53e4', '4b33b4f6-29d4-4e3e-af2f-6a5ae09b1482', 'cada7807-0f73-454a-a8af-ad511991a18e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:47 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:47 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Creating offline snapshot 386035b0-9ca6-4e2b-8659-1935234b0308 of volume e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afa782-3fbb-4629-b342-c063d5a6e092]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:47 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.280s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:47 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:47 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:55:47 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef Jul 22 20:55:48 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-30fa94a1-5186-46de-ab70-5c3e129cac51 tempest-ProjectMemberTests-1773716304 None] Lock "cinder-f5ccc3f1-6ef7-4175-9961-f2b9a486cf27-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:48 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" returned: 0 in 0.430s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:48 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 1G Jul 22 20:55:48 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (3e7a0db6-d394-4f6f-acdd-8bb3e07733bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772253f4-1dca-4e5d-a1ee-f66c19c1cad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772253f4-1dca-4e5d-a1ee-f66c19c1cad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722433739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988c6e8d-8010-4e15-8c76-c7a1f66d14bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:48Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c5170a-7ae7-4292-b12e-da15b6a31cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c5170a-7ae7-4292-b12e-da15b6a31cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eead8b-f0db-41f3-abbe-9ae867a4dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eead8b-f0db-41f3-abbe-9ae867a4dc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988c6e8d-8010-4e15-8c76-c7a1f66d14bc', 'volume_name': 'volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3573b1-daed-4936-b4f3-0b125d204573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3573b1-daed-4936-b4f3-0b125d204573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78e3088-cedc-45db-b4bf-31d1d323451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:48 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Volume 988c6e8d-8010-4e15-8c76-c7a1f66d14bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc', 'volume_size': 1} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:48 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 1G" returned: 0 in 0.403s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:48 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 Jul 22 20:55:48 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:48 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308" returned: 0 in 0.283s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:48 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 is being set with open permissions: ugo+rw Jul 22 20:55:48 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:49 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 Jul 22 20:55:49 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:49 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308" returned: 0 in 0.236s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=161,cinder:INSERT=57,cinder:UPDATE=220,cinder:DELETE=20 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:49 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.info Jul 22 20:55:49 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:49 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.info" returned: 0 in 0.257s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:49 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.info is being set with open permissions: ugo+rw Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:49 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.info Jul 22 20:55:49 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:49 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.info" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722433739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988c6e8d-8010-4e15-8c76-c7a1f66d14bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da5181b04a45f5bd6a241dd759bb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:55:48Z,use_quota=True,user_id='6cdd5da2318243b79dd167e947b9982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Creating volume 988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:55:49 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:49 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc 1073741824 Jul 22 20:55:49 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:49 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-94944092-b739-4c79-94f1-353414b6cc33 tempest-ProjectReaderTests-134062537 None] Create snapshot completed successfully Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-386035b0-9ca6-4e2b-8659-1935234b0308-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-386035b0-9ca6-4e2b-8659-1935234b0308-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:49 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-386035b0-9ca6-4e2b-8659-1935234b0308" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-386035b0-9ca6-4e2b-8659-1935234b0308" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Deleting offline snapshot 386035b0-9ca6-4e2b-8659-1935234b0308 of volume e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] snapshot_file for this snap is: volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[81067dcc-98de-4258-bf13-e9e0e00dca17]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:50 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 Jul 22 20:55:50 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:50 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc 1073741824" returned: 0 in 0.430s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:50 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc Jul 22 20:55:50 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:50 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308" returned: 0 in 0.391s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c33c54-ff42-4cf1-ace2-062e0013302d]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:50 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" returned: 0 in 0.260s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78e3088-cedc-45db-b4bf-31d1d323451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c305126-9477-4aa2-a923-ace2c692cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:55:50 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Volume volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc (988c6e8d-8010-4e15-8c76-c7a1f66d14bc): created successfully Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c305126-9477-4aa2-a923-ace2c692cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Flow 'volume_create_manager' (3e7a0db6-d394-4f6f-acdd-8bb3e07733bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:55:50 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8c3b19bb-b033-4f95-9431-f9afa2f2c208 tempest-ProjectMemberTests-1773716304 None] Created volume successfully. Jul 22 20:55:50 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef Jul 22 20:55:50 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:50 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:50 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:50 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 Jul 22 20:55:50 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:51 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308" returned: 0 in 0.333s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:51 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308 Jul 22 20:55:51 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:51 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef.386035b0-9ca6-4e2b-8659-1935234b0308" returned: 0 in 0.243s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-386035b0-9ca6-4e2b-8659-1935234b0308" released by "_delete_snapshot" :: held 1.416s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" released by "delete_snapshot" :: held 1.439s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Created reservations ['c5e75e69-c542-45b2-951f-2ce808491592', 'c765dd3e-66de-450e-8255-7a6548b3168d', 'cabb593e-d630-422b-9f7d-31bd039b9a20', 'b8e0ba81-5706-4834-9d89-2ca6785a1329'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:51 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Delete snapshot completed successfully. Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-6915e4b4-ef62-4314-9ad3-8ab2b8aa37a2 tempest-ProjectReaderTests-134062537 None] Lock "cinder-386035b0-9ca6-4e2b-8659-1935234b0308-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Creating offline snapshot a2e3889a-27ab-4761-83af-5330ad305951 of volume 988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[065a3b73-4070-4021-a830-d7e2e53788bf]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:51 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:51 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc Jul 22 20:55:51 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:52 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" returned: 0 in 0.365s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 1G {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:52 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 1G Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Lock "cinder-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:52 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Acquiring lock "cinder-quobyte-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa959bf-e778-4547-a3a6-7cdf1d66a590]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:52 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef Jul 22 20:55:52 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:52 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 1G" returned: 0 in 0.420s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:52 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 Jul 22 20:55:52 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:52 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" returned: 0 in 0.373s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:52 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef Jul 22 20:55:52 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:52 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc -F qcow2 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951" returned: 0 in 0.295s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:52 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 is being set with open permissions: ugo+rw Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:52 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 Jul 22 20:55:52 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:52 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" returned: 0 in 0.277s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Lock "cinder-quobyte-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef" released by "delete_volume" :: held 0.707s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Created reservations ['40bb9020-9ff3-4446-ad0b-dbcb3db4d609', '02c57b60-3259-4b6b-aa0e-447750c1de0d', '9db3ad16-d6a9-473a-9405-6fe235495dbd', '72f9e34b-ae72-420a-bd17-eebd2d722e71'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:52 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:53 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:53 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:53 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951" returned: 0 in 0.250s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:53 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.info Jul 22 20:55:53 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:53 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.253s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Deleted volume successfully. Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-44ffc242-ef8a-401a-8487-3a86e75f7d6e tempest-ProjectReaderTests-134062537 None] Lock "cinder-e4cdf82a-a528-4b84-8ebc-2267a8b0a2ef-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:53 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.info" returned: 0 in 0.276s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:53 devstack cinder-volume[87818]: WARNING cinder.volume.drivers.remotefs [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.info is being set with open permissions: ugo+rw Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.info {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:53 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.info Jul 22 20:55:53 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:53 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.info" returned: 0 in 0.249s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:53 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-d9f697da-c7ff-4c33-89bf-bd8ba8443be4 tempest-ProjectMemberTests-1773716304 None] Create snapshot completed successfully Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-a2e3889a-27ab-4761-83af-5330ad305951-delete_snapshot" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Lock "cinder-a2e3889a-27ab-4761-83af-5330ad305951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" by "delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-a2e3889a-27ab-4761-83af-5330ad305951" by "_delete_snapshot" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-a2e3889a-27ab-4761-83af-5330ad305951" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:53 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Deleting offline snapshot a2e3889a-27ab-4761-83af-5330ad305951 of volume 988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] snapshot_file for this snap is: volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 {{(pid=87818) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2850524-aa2e-4545-8531-ed634b3d9a75]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:54 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 Jul 22 20:55:54 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:54 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951" returned: 0 in 0.407s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87818) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b171c-c4d6-42b7-b4e1-705114a367bb]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:54 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc Jul 22 20:55:54 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:54 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" returned: 0 in 0.391s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:54 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:54 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 Jul 22 20:55:54 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:55 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951" returned: 0 in 0.340s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:55 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951 Jul 22 20:55:55 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:55 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:55 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc.a2e3889a-27ab-4761-83af-5330ad305951" returned: 0 in 0.244s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-a2e3889a-27ab-4761-83af-5330ad305951" released by "_delete_snapshot" :: held 1.469s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" released by "delete_snapshot" :: held 1.495s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:55 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Created reservations ['10e86d92-3bd5-4a2d-a279-24ec29683bcf', '3fe2e171-3f3a-446f-b2a7-ee076e62c79c', '1bd98a02-b115-4cd8-825f-98690791f7a2', 'b890227a-e027-4b46-b57c-4767bc88185d'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:55 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Delete snapshot completed successfully. Jul 22 20:55:55 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-c732da29-f250-4b03-98d9-2fb50ab9829e tempest-ProjectMemberTests-1773716304 None] Lock "cinder-a2e3889a-27ab-4761-83af-5330ad305951-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-988c6e8d-8010-4e15-8c76-c7a1f66d14bc-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-988c6e8d-8010-4e15-8c76-c7a1f66d14bc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Acquiring lock "cinder-quobyte-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" acquired by "delete_volume" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2894d1-a4e1-4f85-8e42-dc4962d0c7ff]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:56 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc Jul 22 20:55:56 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:56 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" returned: 0 in 0.348s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:56 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc Jul 22 20:55:56 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:56 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" returned: 0 in 0.245s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-quobyte-988c6e8d-8010-4e15-8c76-c7a1f66d14bc" released by "delete_volume" :: held 0.649s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Created reservations ['d9f76562-1539-40db-940d-9edf34abce24', '232d2ec2-2b7b-4041-9b5d-e5e41991e625', 'e2e42229-21d3-46b3-b44c-3152dad5382b', '245daa4a-fc37-4f49-ab8b-6fa36e194ad8'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:55:56 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:55:56 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:55:56 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:55:57 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 22 20:55:57 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:55:57 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:55:57 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Deleted volume successfully. Jul 22 20:55:57 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-0f06d0d0-c9ca-4b82-89cf-88913d177cbf tempest-ProjectMemberTests-1773716304 None] Lock "cinder-988c6e8d-8010-4e15-8c76-c7a1f66d14bc-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (e5b066de-c17e-46a9-a050-b040bf4515fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce84688-3298-4cf8-9e3c-b172215336cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce84688-3298-4cf8-9e3c-b172215336cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131534856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0800e1c-9076-4ded-bfa9-c652a5e23038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:05Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88dbe5d-0a19-4081-b959-9b5fba851c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88dbe5d-0a19-4081-b959-9b5fba851c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f662ab23-f69b-4df5-bb5f-73a70c7f1d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f662ab23-f69b-4df5-bb5f-73a70c7f1d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0800e1c-9076-4ded-bfa9-c652a5e23038', 'volume_name': 'volume-c0800e1c-9076-4ded-bfa9-c652a5e23038', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c7b91-ee3f-4d10-a1d4-667ffd19a060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c7b91-ee3f-4d10-a1d4-667ffd19a060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46746d18-2cff-4880-a633-74cbb5865a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:04 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Volume c0800e1c-9076-4ded-bfa9-c652a5e23038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0800e1c-9076-4ded-bfa9-c652a5e23038', 'volume_size': 1} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131534856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0800e1c-9076-4ded-bfa9-c652a5e23038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:05Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Creating volume c0800e1c-9076-4ded-bfa9-c652a5e23038 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:56:04 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:56:04 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:04 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 1073741824 Jul 22 20:56:04 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:05 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 1073741824" returned: 0 in 0.397s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:05 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 Jul 22 20:56:05 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:05 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46746d18-2cff-4880-a633-74cbb5865a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0800e1c-9076-4ded-bfa9-c652a5e23038', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2cead2-0979-4934-8e1b-f933a468df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:05 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Volume volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 (c0800e1c-9076-4ded-bfa9-c652a5e23038): created successfully Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2cead2-0979-4934-8e1b-f933a468df02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:05 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (e5b066de-c17e-46a9-a050-b040bf4515fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:05 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-47b0d868-f9bd-4748-b410-ebcc5cc1053a tempest-ProjectReaderTests-654660294 None] Created volume successfully. Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-c0800e1c-9076-4ded-bfa9-c652a5e23038-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Lock "cinder-c0800e1c-9076-4ded-bfa9-c652a5e23038-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-quobyte-c0800e1c-9076-4ded-bfa9-c652a5e23038" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-c0800e1c-9076-4ded-bfa9-c652a5e23038" acquired by "delete_volume" :: waited 0.013s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a7224-3099-4e3a-9394-5a23f19a58d4]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:06 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 Jul 22 20:56:06 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:06 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038" returned: 0 in 0.347s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:06 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038 Jul 22 20:56:06 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:06 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-c0800e1c-9076-4ded-bfa9-c652a5e23038" returned: 0 in 0.243s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-c0800e1c-9076-4ded-bfa9-c652a5e23038" released by "delete_volume" :: held 0.628s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Created reservations ['2c41de9e-9d21-4496-aa8a-e7aa1959e9e6', '425f6ef5-519b-45bd-9943-183bc2354995', 'ff6b7469-0adf-4d25-958e-21d1bef1f1f3', 'eaf83789-551a-41c3-aeb6-83db4fe3ab54'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:06 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:06 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:56:06 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:07 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.237s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:56:07 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Deleted volume successfully. Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-8fbd3234-25c6-4fc1-84bb-4e8ab0ca4089 tempest-ProjectReaderTests-654660294 None] Lock "cinder-c0800e1c-9076-4ded-bfa9-c652a5e23038-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (43c4ffe9-d7b2-4d1c-bd7a-01d785763e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406b5be4-c382-48cd-9ec0-9277bb313727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406b5be4-c382-48cd-9ec0-9277bb313727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581693452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bad01f-3382-44ff-8e63-412eaacc5eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:08Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e0d10f-fc87-4c1a-9449-9d4b3b156361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e0d10f-fc87-4c1a-9449-9d4b3b156361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1248465-c92d-4df9-9dfb-be0eca3e09bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1248465-c92d-4df9-9dfb-be0eca3e09bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bad01f-3382-44ff-8e63-412eaacc5eca', 'volume_name': 'volume-52bad01f-3382-44ff-8e63-412eaacc5eca', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c7801c-c0a9-4c29-a14e-cdb99c05d25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c7801c-c0a9-4c29-a14e-cdb99c05d25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a181467-b024-4cd7-8f36-73f15843c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:07 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Volume 52bad01f-3382-44ff-8e63-412eaacc5eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bad01f-3382-44ff-8e63-412eaacc5eca', 'volume_size': 1} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581693452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bad01f-3382-44ff-8e63-412eaacc5eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:08Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Creating volume 52bad01f-3382-44ff-8e63-412eaacc5eca {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:56:07 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:56:07 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:07 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca 1073741824 Jul 22 20:56:07 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:08 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca 1073741824" returned: 0 in 0.405s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:08 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca Jul 22 20:56:08 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:08 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca" returned: 0 in 0.242s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a181467-b024-4cd7-8f36-73f15843c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bad01f-3382-44ff-8e63-412eaacc5eca', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aebcbe9-8851-48cc-8e1d-1f4c4d8d4338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:08 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Volume volume-52bad01f-3382-44ff-8e63-412eaacc5eca (52bad01f-3382-44ff-8e63-412eaacc5eca): created successfully Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aebcbe9-8851-48cc-8e1d-1f4c4d8d4338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (43c4ffe9-d7b2-4d1c-bd7a-01d785763e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:08 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-83cdd873-fb3e-4045-a81b-659596a189e1 tempest-ProjectReaderTests-654660294 None] Created volume successfully. Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-52bad01f-3382-44ff-8e63-412eaacc5eca-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Lock "cinder-52bad01f-3382-44ff-8e63-412eaacc5eca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-quobyte-52bad01f-3382-44ff-8e63-412eaacc5eca" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-52bad01f-3382-44ff-8e63-412eaacc5eca" acquired by "delete_volume" :: waited 0.016s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95933e-8df4-40ee-a22a-e680cf926e2c]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:56:08 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:08 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca Jul 22 20:56:08 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:09 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca" returned: 0 in 0.355s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:09 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca Jul 22 20:56:09 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:09 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-52bad01f-3382-44ff-8e63-412eaacc5eca" returned: 0 in 0.240s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-52bad01f-3382-44ff-8e63-412eaacc5eca" released by "delete_volume" :: held 0.632s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Created reservations ['6845d26d-f74a-4fc6-820e-9314a2f1ed71', 'cec2475f-1f58-40d2-8832-5da228a63c8d', '92e8e7db-f3e9-4fe8-a489-aa4bca45ede7', '4229eff6-1202-44f5-a2da-f268c8dd461e'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:09 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:56:09 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:09 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.241s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:56:09 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Deleted volume successfully. Jul 22 20:56:09 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-de5578b6-44de-4763-b54f-490ecb742c6e tempest-ProjectReaderTests-654660294 None] Lock "cinder-52bad01f-3382-44ff-8e63-412eaacc5eca-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (a1a0e409-d402-4a7b-b52f-23b22ce5f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9fd2e8-32d1-4928-99d4-deed5bdae630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9fd2e8-32d1-4928-99d4-deed5bdae630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485485234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61dcd76-4552-41fc-ba57-cd8decdde458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:10Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdffe5d-d648-4aa7-b9f9-2c8879921004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdffe5d-d648-4aa7-b9f9-2c8879921004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0d3126-0534-4ac0-a2c0-bdf359dd26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0d3126-0534-4ac0-a2c0-bdf359dd26c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61dcd76-4552-41fc-ba57-cd8decdde458', 'volume_name': 'volume-a61dcd76-4552-41fc-ba57-cd8decdde458', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea02ab84-b4d9-4163-8b60-ba8f65904b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea02ab84-b4d9-4163-8b60-ba8f65904b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dea6054-c289-474a-8862-d34ae4d82f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:10 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Volume a61dcd76-4552-41fc-ba57-cd8decdde458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61dcd76-4552-41fc-ba57-cd8decdde458', 'volume_size': 1} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485485234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61dcd76-4552-41fc-ba57-cd8decdde458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:10Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Creating volume a61dcd76-4552-41fc-ba57-cd8decdde458 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:56:10 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:10 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 1073741824 Jul 22 20:56:10 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:10 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 1073741824" returned: 0 in 0.402s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:10 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 Jul 22 20:56:10 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:10 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458" returned: 0 in 0.236s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dea6054-c289-474a-8862-d34ae4d82f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61dcd76-4552-41fc-ba57-cd8decdde458', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:10 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91935c-ec68-4377-8941-41aaa1eb3b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:11 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Volume volume-a61dcd76-4552-41fc-ba57-cd8decdde458 (a61dcd76-4552-41fc-ba57-cd8decdde458): created successfully Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91935c-ec68-4377-8941-41aaa1eb3b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (a1a0e409-d402-4a7b-b52f-23b22ce5f602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:11 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-19bfc4fe-3658-4996-9fca-eb2e5f301115 tempest-ProjectReaderTests-654660294 None] Created volume successfully. Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-a61dcd76-4552-41fc-ba57-cd8decdde458-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Lock "cinder-a61dcd76-4552-41fc-ba57-cd8decdde458-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-quobyte-a61dcd76-4552-41fc-ba57-cd8decdde458" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-a61dcd76-4552-41fc-ba57-cd8decdde458" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[28abdd43-88d7-4c84-986b-f7d32beda128]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:11 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 Jul 22 20:56:11 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:11 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458" returned: 0 in 0.359s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:11 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458 Jul 22 20:56:11 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:11 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-a61dcd76-4552-41fc-ba57-cd8decdde458" returned: 0 in 0.246s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:11 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-a61dcd76-4552-41fc-ba57-cd8decdde458" released by "delete_volume" :: held 0.650s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Created reservations ['0c119d79-6d18-44b1-b4c3-3683d29b6eaa', '1f7182ee-89cb-4843-85d4-b9240ba8faef', '5d8f7c80-f5ef-475c-b71e-2070b73b432d', '024e7fce-738f-49de-b831-8162844cdc29'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:12 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:56:12 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:12 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.237s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:56:12 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Deleted volume successfully. Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-edb85e80-95d0-4299-b920-5080dbb44295 tempest-ProjectReaderTests-654660294 None] Lock "cinder-a61dcd76-4552-41fc-ba57-cd8decdde458-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87818) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (6a658858-e998-474f-a7ae-87332485a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ffd7e4-cf1e-4022-9f3b-a235e72c7ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ffd7e4-cf1e-4022-9f3b-a235e72c7ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433225263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357ef0f5-453d-40e3-89f6-974a36199551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:13Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacef22b-c12e-4c3d-84ce-685926b31e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacef22b-c12e-4c3d-84ce-685926b31e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab11ba8d-2500-4db6-8119-0ba95069b5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab11ba8d-2500-4db6-8119-0ba95069b5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357ef0f5-453d-40e3-89f6-974a36199551', 'volume_name': 'volume-357ef0f5-453d-40e3-89f6-974a36199551', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac83cca0-29dd-4c51-a011-5a75efab00f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac83cca0-29dd-4c51-a011-5a75efab00f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cf23b9-e108-4158-8e52-5bba587d2e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:12 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Volume 357ef0f5-453d-40e3-89f6-974a36199551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357ef0f5-453d-40e3-89f6-974a36199551', 'volume_size': 1} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T18:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433225263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357ef0f5-453d-40e3-89f6-974a36199551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb99ceac1dfe4fa9b291da60c1a9f18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T18:56:13Z,use_quota=True,user_id='5b0c79e54a8443e494e9876084efa82a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42dcae44-2b6a-465c-bfec-923cb0c3526e),volume_type_id=42dcae44-2b6a-465c-bfec-923cb0c3526e)}" {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.remotefs [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Creating volume 357ef0f5-453d-40e3-89f6-974a36199551 {{(pid=87818) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Selected osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 as target Quobyte volume. {{(pid=87818) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 20:56:12 devstack cinder-volume[87818]: INFO cinder.volume.drivers.remotefs [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] casted to osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789 Jul 22 20:56:12 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 1073741824 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:12 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 1073741824 Jul 22 20:56:12 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:13 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 1073741824" returned: 0 in 0.390s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:13 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 Jul 22 20:56:13 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:13 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551" returned: 0 in 0.247s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'} {{(pid=87818) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cf23b9-e108-4158-8e52-5bba587d2e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357ef0f5-453d-40e3-89f6-974a36199551', 'volume_size': 1}' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0fe964-7978-4606-b575-9ca52494488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 20:56:13 devstack cinder-volume[87818]: INFO cinder.volume.flows.manager.create_volume [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Volume volume-357ef0f5-453d-40e3-89f6-974a36199551 (357ef0f5-453d-40e3-89f6-974a36199551): created successfully Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0fe964-7978-4606-b575-9ca52494488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87818) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Flow 'volume_create_manager' (6a658858-e998-474f-a7ae-87332485a99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87818) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 20:56:13 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-8ff78abb-304c-40af-9c3d-dfd2dd3f0d6b tempest-ProjectReaderTests-654660294 None] Created volume successfully. Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-357ef0f5-453d-40e3-89f6-974a36199551-delete_volume" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Lock "cinder-357ef0f5-453d-40e3-89f6-974a36199551-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Acquiring lock "cinder-quobyte-357ef0f5-453d-40e3-89f6-974a36199551" by "delete_volume" {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 20:56:13 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-357ef0f5-453d-40e3-89f6-974a36199551" acquired by "delete_volume" :: waited 0.017s {{(pid=87818) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2efa1a1-3964-43ee-9b2d-893bb11e4846]: (4, 'qcow2') {{(pid=89258) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:14 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 Jul 22 20:56:14 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:14 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551" returned: 0 in 0.343s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:14 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551 Jul 22 20:56:14 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:14 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917/volume-357ef0f5-453d-40e3-89f6-974a36199551" returned: 0 in 0.237s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Lock "cinder-quobyte-357ef0f5-453d-40e3-89f6-974a36199551" released by "delete_volume" :: held 0.619s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG cinder.quota [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Created reservations ['e47220a7-9d36-4042-a1f3-eaab5fd1a4cd', '700100c4-ea67-4d03-8450-60bd96314336', 'e8ec0360-5565-4659-a92d-32644b9632cb', 'be875516-9b3d-4fe7-86ba-92d375e3b5e3'] {{(pid=87818) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789': None} {{(pid=87818) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG cinder.volume.drivers.quobyte [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27a9cb94-db81-4350-b529-2ddf5f20e789'] {{(pid=87818) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.lockutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87818) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 20:56:14 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917 Jul 22 20:56:14 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 20:56:14 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG oslo_concurrency.processutils [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a47fa9000d6720022f9b30334ed99917" returned: 0 in 0.243s {{(pid=87818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG cinder.manager [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Notifying Schedulers of capabilities ... {{(pid=87818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 20:56:14 devstack cinder-volume[87818]: INFO cinder.volume.manager [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Deleted volume successfully. Jul 22 20:56:14 devstack cinder-volume[87818]: DEBUG cinder.coordination [None req-bcdf1aed-9351-43da-a819-53c158e55ae7 tempest-ProjectReaderTests-654660294 None] Lock "cinder-357ef0f5-453d-40e3-89f6-974a36199551-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87818) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 20:56:24 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:UPDATE=82,cinder:SELECT=57,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:56:24 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=51,cinder:DELETE=7,cinder:INSERT=22,cinder:UPDATE=76 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 20:56:36 devstack cinder-volume[87818]: DEBUG dbcounter [-] [87818] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}